-- Logs begin at Wed 2022-08-24 17:10:34 UTC, end at Wed 2022-08-24 18:06:49 UTC. -- Aug 24 17:39:42.792847 dv-cinder-840525-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 17:39:42.803059 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 17:39:42.805030 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 17:39:42 2022] *** Aug 24 17:39:42.805030 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 17:39:42.805030 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 17:39:42.805030 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: nodename: dv-cinder-840525-3-iscsi Aug 24 17:39:42.805030 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: machine: x86_64 Aug 24 17:39:42.805030 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: clock source: unix Aug 24 17:39:42.805030 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: pcre jit disabled Aug 24 17:39:42.805030 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: detected number of CPU cores: 4 Aug 24 17:39:42.805030 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: current working directory: / Aug 24 17:39:42.805030 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: detected binary path: /usr/bin/uwsgi-core Aug 24 17:39:42.805730 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: your processes number limit is 47680 Aug 24 17:39:42.805730 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: your memory page size is 4096 bytes Aug 24 17:39:42.805730 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: detected max file descriptor number: 2048 Aug 24 17:39:42.805730 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: lock engine: pthread robust mutexes Aug 24 17:39:42.805730 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: thunder lock: enabled Aug 24 17:39:42.805730 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 17:39:42.805730 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 17:39:42.860179 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: Python main interpreter initialized at 0x56010c9a59c0 Aug 24 17:39:42.860179 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: python threads support enabled Aug 24 17:39:42.860179 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: your server socket listen backlog is limited to 100 connections Aug 24 17:39:42.860179 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: your mercy for graceful operations on workers is 90 seconds Aug 24 17:39:42.860575 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 17:39:42.860575 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: *** Operational MODE: preforking *** Aug 24 17:39:42.860846 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: *** uWSGI is running in multiple interpreter mode *** Aug 24 17:39:42.860846 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: spawned uWSGI master process (pid: 111980) Aug 24 17:39:42.861043 dv-cinder-840525-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 17:39:42.865998 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: spawned uWSGI worker 1 (pid: 111981, cores: 1) Aug 24 17:39:42.865998 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: spawned uWSGI worker 2 (pid: 111982, cores: 1) Aug 24 17:39:42.865998 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 17:39:43.516867 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:39:43.520830 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:39:44.587201 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:39:44.587201 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: from cryptography.utils import int_from_bytes Aug 24 17:39:44.587881 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:39:44.587881 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: from cryptography.utils import int_from_bytes Aug 24 17:39:44.592213 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:39:44.592213 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: from cryptography.utils import int_from_bytes Aug 24 17:39:44.593129 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:39:44.593129 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: from cryptography.utils import int_from_bytes Aug 24 17:39:47.039662 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:39:47.040313 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:39:47.040410 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:39:47.040771 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:39:47.041021 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:39:47.041398 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.041718 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.042033 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.042346 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.042671 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.042976 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.043180 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:39:47.043567 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.043652 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:39:47.043728 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.043924 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.044021 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:39:47.044182 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.044334 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:39:47.044472 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.044577 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:39:47.044797 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840525-3-iscsi {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.044964 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.045112 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.045289 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.045413 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.046209 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.046309 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.046472 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.046568 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.046803 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.046891 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.047118 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.047222 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.047440 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.047547 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.047781 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.047951 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.048111 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.048376 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.048474 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.048678 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.048765 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.048984 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.049071 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840525-3-iscsi {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.049314 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.049409 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.049620 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.049707 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.049922 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.050023 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.050232 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.050320 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.050535 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.050621 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.050856 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.050949 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.051158 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.051245 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.051569 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840525-3-iscsi {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.051680 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.051886 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.051988 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.052195 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.052289 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.052506 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.052605 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.052890 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.052975 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.053205 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.053292 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.053507 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.053593 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.053820 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.053913 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.054127 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.054240 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.054429 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.054517 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.054764 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.054896 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.055060 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.055150 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840525-3-iscsi {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.055372 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.055459 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.055714 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.055805 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.056011 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.056104 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.056314 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.056519 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.056614 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.056837 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.056930 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.057147 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.057235 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.057469 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.057558 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.057730 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.057816 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.058032 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.058129 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.058349 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.058438 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.058665 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.058752 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.058982 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.059085 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.059231 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.059318 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.059495 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.059641 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.059821 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.059955 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.060138 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.060262 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.060441 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.060583 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.060744 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.060890 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.061051 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.061721 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.061911 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.062000 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.062274 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.062462 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.062598 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.062847 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.062941 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.063156 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.063284 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.063491 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.063586 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.063746 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.064066 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.064165 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.064389 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.064485 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.064700 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.064799 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.065010 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.065107 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.065318 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.065406 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.065624 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.065710 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.065931 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.066030 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.066234 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.066373 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.066539 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.066626 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.066847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.066943 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.067164 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.067251 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.067494 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.067596 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.067816 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.067904 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.068119 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.068207 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.068424 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.068511 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.068729 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.068827 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.069044 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.069131 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.069353 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.069446 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.069659 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.069745 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.069907 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.070001 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.070205 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.070292 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.070505 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.070593 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.070818 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.070904 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.071124 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.071224 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.071426 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.071561 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.071751 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.071838 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.072048 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.072148 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.072348 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.072435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.072647 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.072734 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.072948 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.073043 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.073247 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.073334 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.073547 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.073633 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.073846 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.073942 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.074146 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.074232 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.074445 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.074577 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.074744 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.074835 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.075042 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.075127 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.075348 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.075434 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.075678 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.075766 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.075976 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.076061 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.076276 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.076373 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.076577 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.076667 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.076906 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.077020 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.077215 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.077556 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.077656 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.077866 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.077994 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.078187 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.078476 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.078570 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.078802 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.078943 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.079108 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.079398 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.079532 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.079733 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.079833 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.080043 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.080135 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.080345 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.080430 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.080651 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.080746 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.080956 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.081049 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.081261 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.081347 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.081566 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.081660 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.081869 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.081955 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.082173 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.082259 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.082474 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.082562 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.082776 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.082862 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.083077 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.083162 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.083377 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.083464 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.083712 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.083799 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.084017 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.084102 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.084312 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.084406 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.084619 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.084704 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.084925 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.085023 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.085226 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.085528 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.085661 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.085768 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.085855 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.085934 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.086115 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.086209 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.086414 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.086501 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.086734 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.086834 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.087055 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.087141 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.087363 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.087458 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.087702 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.087801 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.088011 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.088098 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.088331 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:39:47.088418 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.088637 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.088735 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.088948 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.089042 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.089272 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.089361 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.089582 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.089669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.089891 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.089978 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.090199 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.090287 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.090513 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.090608 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.090832 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.090919 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.091159 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.091245 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.091495 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.091586 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.091808 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.091894 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.092120 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.092216 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.092446 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.092533 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.092761 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.092848 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.093079 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.093173 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.093392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.093478 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.093699 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.093789 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.094019 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.094104 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.094339 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.094427 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.094653 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.094789 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.094968 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.095068 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.095284 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.095373 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.095616 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.095708 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.095925 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.096025 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.096231 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.096326 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.096548 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.096634 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.096880 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.096979 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.097189 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.097277 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.097503 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.097590 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.097812 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.097909 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.098119 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.098214 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.098425 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.098519 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.098732 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.098830 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.099038 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.099136 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.099368 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.099455 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.099705 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.099795 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.100016 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.100103 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.100323 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.100417 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.100888 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.100985 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.101192 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.101279 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.101498 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.101586 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.101826 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.101919 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.102105 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.102192 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.102404 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.102499 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.102703 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.102802 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.103009 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.103096 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.103308 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.103403 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.103646 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.103737 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.103967 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.104054 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.104268 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.104367 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.104575 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.104670 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.104884 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.104980 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.105190 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.105293 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.105495 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.105590 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.105803 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.105891 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.106107 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.106203 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.106414 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.106508 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.106723 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.106855 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.107024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.107113 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.107343 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.107429 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.107683 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.107774 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.108546 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.108679 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.108818 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.108907 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.109132 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.109225 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.109434 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.109570 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.109743 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.109838 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.110050 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.110137 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.110357 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.110454 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.110663 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.110752 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.110975 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.111072 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.111293 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.111380 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.111640 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.111730 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.111948 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.112048 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.112261 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.112347 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.112575 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.112663 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.112877 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.112972 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.113191 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.113286 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.113508 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.113594 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.113820 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.113913 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.114119 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.114212 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.114424 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.114520 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.114725 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.114814 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.115026 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.115150 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.115323 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.115424 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.115655 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.115745 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.115955 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.116042 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.116256 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.116342 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.116556 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.116645 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.116857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.116988 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.117161 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.117255 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.117479 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.117567 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.117788 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.117875 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.118086 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.118179 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.118386 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.118482 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.118686 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.118810 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.118988 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.119156 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.119293 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.119381 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.119639 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.119743 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.119958 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.120061 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.120265 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.120361 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.120573 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.120662 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.120881 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.120977 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.121196 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.121282 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.121507 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.121595 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.121819 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.121907 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.122127 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.122221 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.122436 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.122531 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.122752 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.122852 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.123060 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.123146 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.123377 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.123472 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.124259 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.124373 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.124586 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.124673 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.124896 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.124991 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.125209 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.125296 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.125509 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.125597 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.125825 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.125926 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.126145 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.126232 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.126460 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.126547 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.126780 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.126875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.127091 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.127178 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.127396 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.127509 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.127732 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.127834 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.128041 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.128129 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.128350 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.128436 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.128658 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.128759 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.128967 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.129055 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.129282 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.129370 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.129588 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.129684 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.129902 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.129988 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.130208 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.130294 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.130518 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.130605 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.130822 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.130909 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.131136 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.131221 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.131435 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.131553 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.131769 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.131865 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.132087 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.132173 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.132401 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.132490 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.132708 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.132793 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.133015 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.133102 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.133329 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.133424 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.133633 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.133718 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.133936 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.134030 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.134244 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.134331 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.134544 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.134637 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.134846 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.134947 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.135151 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.135238 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.135459 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.135626 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.135787 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.135888 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.136092 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.136181 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.136391 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.136478 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.136693 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.136789 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.136994 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.137088 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.137293 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.137388 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.137591 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.137686 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.137895 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.137982 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.138207 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.138293 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.138510 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.138605 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.138824 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.138909 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.139133 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.139243 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.139455 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.139576 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.139777 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.139864 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.140086 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.140179 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.140393 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.140517 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.140691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.140788 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.140998 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.141085 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.141297 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.141393 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.141614 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.141700 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.141919 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.142022 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.142215 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.142300 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.142525 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.142618 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.142830 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.142924 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.143133 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.143218 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.143436 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.143539 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.143783 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.143881 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.144091 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.144178 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.144395 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.144481 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.144703 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.144798 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.145006 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.145094 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.145311 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.145402 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.145616 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.145707 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.145918 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.146005 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.146221 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.146308 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.146538 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.146627 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.146842 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.146929 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.147145 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.147269 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.147448 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.147578 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.147769 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.147858 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.148072 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.148160 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.148383 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.148472 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.148709 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.148947 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.149034 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.149274 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.149362 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.149586 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.149673 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.149902 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.149990 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.150216 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.150303 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.150528 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.150614 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.150861 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.151093 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.151189 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.151427 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.151532 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.151788 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.151885 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.152108 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.152201 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.152411 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.152499 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.152713 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.152801 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.153021 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.153119 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.153322 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.153448 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.153624 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.153714 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.153927 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.154024 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.154233 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.154329 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.154533 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.154619 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.154844 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.154935 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.155152 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.155252 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.155451 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.155597 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.155783 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.155882 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.156084 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.156173 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.156389 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.156476 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.156688 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.156776 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.156993 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.157088 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.157296 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.157426 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.157596 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.157695 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.157895 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.157984 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.158194 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.158281 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.158504 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.158590 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.158809 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.158898 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.159134 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.159221 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.159446 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.159565 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.159794 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.159883 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.160095 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.160180 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.160396 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.160491 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.160715 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.160802 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.161020 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.161107 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.161319 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.161414 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.161618 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.161713 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.161922 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.162009 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.162227 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.162316 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.162526 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.162613 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.162830 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.162916 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.163143 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.163238 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.163435 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.163540 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.163764 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.163850 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.164061 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.164150 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.164364 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.164451 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.164661 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.164749 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.164969 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.165056 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.165270 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.165358 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.165567 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.165663 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.165864 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.165959 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.166163 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.166249 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.166464 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.166559 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.166762 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.166851 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.167067 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.167162 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.167366 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.167531 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.167700 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.167790 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.168000 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.168095 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.168299 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.168399 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.168596 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.168683 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.168899 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.168987 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.169202 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.169289 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.169500 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.169587 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.169816 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.169904 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.170120 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.170214 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.170415 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.171003 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.171228 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.171329 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.171559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.171653 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.171860 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.171947 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.172155 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.172242 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.172460 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.172551 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.172779 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.172867 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.173092 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.173188 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.173393 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.173489 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.173699 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.173794 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.173999 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.174095 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.174299 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.174394 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.174599 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.174694 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.174904 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.174999 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.175203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.175290 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.175517 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.175655 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.175821 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.175922 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.176119 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.176207 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.176418 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.176516 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.176722 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.176817 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.177028 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.177114 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.177328 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.177416 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.177631 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.177717 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.177926 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.178021 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.178230 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.178323 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.178536 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.178625 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.178860 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.178946 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.179172 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.179259 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.179537 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.179630 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.179808 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.179895 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.180113 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.180212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.180417 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.180510 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.180728 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.180815 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.181034 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.181130 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.181348 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.181435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.181655 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.181749 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.181964 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.182059 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.182264 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.182351 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.182564 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.182650 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.182880 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.182976 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.183186 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.183273 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.183510 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.183600 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.183827 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.183923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.184142 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.184228 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.184449 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.184541 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.184749 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.184836 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.185057 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.185143 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.185363 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.185451 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.185668 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.185756 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.185972 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.186059 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.186859 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.186955 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.187170 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.187259 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.187493 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.187599 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.187810 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.187898 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.188116 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.188204 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.188421 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.188508 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.188724 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.188821 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.189033 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.189127 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.189339 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.189434 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.189639 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.189742 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.189956 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.190042 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.190260 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.190353 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.190561 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.190658 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.190865 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.190960 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.191173 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.191268 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.191513 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.191617 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.191796 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.191884 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.192121 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.192213 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.192435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.192523 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.192743 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.192829 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.193057 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.193144 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.193367 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.193462 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.193676 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.193763 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.193980 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.194065 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.194285 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.194408 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.194584 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.194723 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.194993 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.195129 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.195301 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.195426 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.195632 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.195746 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.195936 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.196068 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.196240 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.196385 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.196531 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.196618 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.196836 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.196933 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.197155 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.197243 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.197456 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.197543 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.197755 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.197850 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.198054 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.198141 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.198369 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.198463 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.198669 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.198768 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.198984 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.199071 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.199333 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.199431 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.199670 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.199760 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.199979 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.200066 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.200289 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.200375 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.200614 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.200702 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.200921 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.201007 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.201244 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.201332 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.201590 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.201678 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.202423 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.202515 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.202727 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.202816 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.203034 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.203229 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.203342 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.203642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.203733 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.203961 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.204075 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.204288 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.204386 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.204599 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.204685 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.204901 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.204988 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.205221 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.205318 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.205534 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.205622 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.205840 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.205972 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.206158 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.206258 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.206480 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.206578 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.206795 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.206882 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.207113 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.207202 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.207422 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.207552 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.207773 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.207898 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.208091 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.208179 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.208395 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.208490 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.208717 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.208823 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.209006 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.209120 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.209309 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.209448 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.209626 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.209768 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.209928 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.210092 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.210234 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.210448 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.210536 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.210759 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.210848 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.211066 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.211153 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.211378 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.211465 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.211709 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.211802 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.212017 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.212105 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.212331 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.212495 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.212636 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.212723 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.212948 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.213043 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.213260 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.213359 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.213559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.213652 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.213867 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.213953 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.214173 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.214267 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.214472 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.214560 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.214773 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.214860 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.215072 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.215167 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.215399 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.215539 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.215722 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.215809 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.216039 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.216172 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.216364 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.216455 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.216686 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.216774 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.216993 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.217081 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.217304 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.217432 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.218148 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.218250 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.218465 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.218557 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.218779 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.218866 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.219099 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.219187 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.219400 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.219513 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.219723 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.219821 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.220032 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.220134 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.220334 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.220451 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.220636 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.220789 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.220936 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.221119 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.221245 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.221443 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.221529 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.221764 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.221851 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.222092 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.222181 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.222401 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.222487 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.222701 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.222787 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.223013 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.223101 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.223316 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.223402 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.223639 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.223747 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.223943 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.224030 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.224244 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.224352 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.224547 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.224643 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.224855 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.224942 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.225163 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.225250 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.225709 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.225811 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.226034 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.226166 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.226344 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.226438 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.226654 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.226753 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.226957 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.227044 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.227267 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.227354 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.227596 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.227689 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.227920 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.228019 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.228239 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.228331 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.228540 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.228629 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.228850 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.228944 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.229160 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.229247 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.229474 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.229562 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.229794 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.229985 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.230112 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.230307 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.230428 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.230617 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.230745 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.230926 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.231062 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.231237 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.231379 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.231568 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.231721 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.231876 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.232038 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.232181 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.232353 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.232486 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.232671 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.232792 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.233132 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.233231 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.233452 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.233539 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.233766 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.233853 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.234088 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.234177 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.234418 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.234505 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.234731 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.234828 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.235043 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.235132 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.235353 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.235440 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.235690 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.235789 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.236040 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.236133 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.236349 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.236437 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.236653 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.236753 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.236961 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.237049 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.237272 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.237360 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.237582 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.237677 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.237890 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.237978 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.238197 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.238324 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.238509 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.238598 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.238820 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.238907 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.239129 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.239218 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.239438 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.239572 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.239769 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.239859 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.240081 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.240178 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.240402 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.240498 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.240735 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.240824 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.241049 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.241149 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.241357 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.241443 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.241669 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.241756 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.241982 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.242146 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.242299 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.242491 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.242613 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.242804 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.242930 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.243133 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.243246 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.243454 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.243619 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.243799 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.243905 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.244110 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.244227 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.244422 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.244544 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.244744 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.244862 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.245048 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.245179 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.245349 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.245659 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.245745 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.245967 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.246055 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.246270 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.246402 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.246588 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.246688 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.246898 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.246987 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.247203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.247290 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.247546 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.247651 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.247855 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.247943 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.248209 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.248383 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.248517 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.248755 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.248874 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.249076 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.249225 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.249398 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.249536 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.249720 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.249817 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.250036 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.250126 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.250344 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.250434 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.250667 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.250757 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.250976 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.251064 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.251281 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.251556 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.251648 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.251909 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.251996 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.252209 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.252298 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.252513 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.252610 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.252822 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.252909 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.253131 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.253217 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.253433 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.253522 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.253741 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.253828 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.254040 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.254136 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.254360 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.254447 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.254662 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.254750 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.254965 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.255065 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.255267 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.255354 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.255599 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.255690 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.255903 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.256008 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.256204 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.256291 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.256506 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.256593 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.256806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.256906 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.257113 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.257201 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.257409 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.257496 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.257714 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.257816 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.258014 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.258102 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.258318 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.258412 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.258615 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.258704 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.258919 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.259016 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.259219 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.259306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.259547 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.259638 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.259849 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.259935 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.260163 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.260251 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.260470 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.260559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.260782 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.260877 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.261086 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.261173 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.261398 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.261487 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.261700 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.261794 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.262011 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.262107 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.262317 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.262405 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.262643 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.262853 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.262951 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.263183 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.263296 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.263516 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.263647 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.263847 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.263963 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.264176 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.264831 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.265002 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.265123 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.265304 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.265437 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.265606 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.265785 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.265929 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.266106 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.266237 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.266544 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.266632 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.266851 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.266974 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.267157 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.267299 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.267461 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.267662 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.267788 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.268001 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.268090 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.268312 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.268408 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.268621 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.268717 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.268931 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.269018 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.269262 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.269352 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.269564 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.269650 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.269869 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.269965 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.270175 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.270265 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.270485 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.270580 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.270812 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.270899 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.271126 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.271215 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.271434 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.271538 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.271769 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.271934 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.272080 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.272176 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.272383 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.272472 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.272688 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.272788 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.272992 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.273080 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.273296 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.273383 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.273606 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.273706 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.273925 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.274021 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.274232 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.274327 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.274534 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.274623 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.274882 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.274968 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.275201 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.275288 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.275544 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.275637 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.275861 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.275949 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.276167 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.276260 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.276478 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.276566 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.276791 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.276918 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.277096 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.277190 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.277412 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.277501 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.277719 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.277815 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.278029 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.278124 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.278363 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.278459 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.278688 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.278776 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.279008 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.279104 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.279308 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.279404 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.279645 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.279746 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.280483 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.280588 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.280800 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.280887 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.281120 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.281215 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.281423 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.281518 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.281720 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.281809 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.282018 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.282105 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.282323 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.282448 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.282623 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.282782 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.282922 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.283111 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.283209 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.283421 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.283562 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.283756 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.283851 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.284065 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.284158 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.284379 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.284466 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.284673 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.284759 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.284972 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.285070 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.285268 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.285356 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.285565 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.285672 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.285870 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.285959 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.286165 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.286253 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.286464 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.286551 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.286760 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.286856 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.287060 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.287148 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.287356 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.287456 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.287683 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.287785 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.287989 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.288078 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.288295 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.288392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.288600 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.288695 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.288905 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.289000 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.289211 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.289306 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.289514 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.289601 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.289870 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.289963 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.290133 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.290230 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.290436 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.290524 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.290739 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.290833 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.291041 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.291129 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.291365 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.291451 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.291696 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.291784 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.292004 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.292101 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.292313 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.292402 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.292621 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.292709 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.292929 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.293024 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.293238 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.293332 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.293560 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.293646 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.293863 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.293952 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.294182 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.294268 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.294494 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.294594 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.294811 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.294900 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.295123 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.295210 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.295431 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.295615 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.295788 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.295876 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.296094 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.296180 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.296402 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.296500 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.296709 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.296797 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.297016 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.297103 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.297322 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.297411 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.297632 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.297732 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.297936 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.298024 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.298242 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.298332 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.298555 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.298643 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.298869 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.299005 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.299183 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.299270 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.299537 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.299641 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.299859 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.299960 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.300175 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.300263 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.300490 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.300577 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.300805 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.300969 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.301118 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.301206 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.301437 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.301524 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.301751 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.301853 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.302064 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.302153 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.302370 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.302456 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.302673 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.302762 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.302914 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:39:47.303009 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.303322 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.303663 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.303994 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.304325 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.304675 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.304992 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.305338 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.305670 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.305988 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.306303 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.306612 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:39:47.306858 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:39:47.456487 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO dbcounter [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Registered counter for database nova_api Aug 24 17:39:47.459849 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO dbcounter [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Registered counter for database nova_api Aug 24 17:39:47.476353 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_db.sqlalchemy.engines [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:47.479529 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG oslo_db.sqlalchemy.engines [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:47.483126 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writer thread running {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:47.485971 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG dbcounter [-] [111981] Writer thread running {{(pid=111981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:47.540187 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.context [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39b63279-b6ad-4ef4-bccd-f728c091053f(cell1) {{(pid=111982) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:39:47.542148 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.context [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39b63279-b6ad-4ef4-bccd-f728c091053f(cell1) {{(pid=111981) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:39:47.543974 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:47.544478 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:47.546560 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG oslo_concurrency.lockutils [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:47.546688 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:47.547033 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG oslo_concurrency.lockutils [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:47.547369 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:47.547840 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:47.548648 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG oslo_concurrency.lockutils [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:47.549375 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG oslo_concurrency.lockutils [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:39:47.549819 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:47.549910 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG oslo_concurrency.lockutils [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:39:47.551824 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG oslo_concurrency.lockutils [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:39:47.551930 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO dbcounter [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Registered counter for database nova_cell0 Aug 24 17:39:47.553803 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO dbcounter [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Registered counter for database nova_cell0 Aug 24 17:39:47.557241 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO dbcounter [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Registered counter for database nova_cell1 Aug 24 17:39:47.559164 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO dbcounter [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Registered counter for database nova_cell1 Aug 24 17:39:47.566702 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_db.sqlalchemy.engines [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:47.567507 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_db.sqlalchemy.engines [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:47.568381 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG oslo_db.sqlalchemy.engines [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:47.569596 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG oslo_db.sqlalchemy.engines [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:47.574383 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writer thread running {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:47.575861 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writer thread running {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:47.575974 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG dbcounter [-] [111981] Writer thread running {{(pid=111981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:47.578726 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG dbcounter [-] [111981] Writer thread running {{(pid=111981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:47.719422 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO dbcounter [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Registered counter for database nova_cell0 Aug 24 17:39:47.722097 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO dbcounter [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Registered counter for database nova_cell0 Aug 24 17:39:47.728621 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_db.sqlalchemy.engines [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:47.730138 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG oslo_db.sqlalchemy.engines [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:39:47.733134 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writer thread running {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:47.735173 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG dbcounter [-] [111981] Writer thread running {{(pid=111981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:39:48.071837 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: WARNING keystonemiddleware.auth_token [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:39:48.078127 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: WARNING keystonemiddleware.auth_token [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:39:48.080622 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: WARNING keystonemiddleware.auth_token [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:39:48.085417 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: WARNING keystonemiddleware.auth_token [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:39:48.423434 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: WARNING keystonemiddleware.auth_token [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:39:48.429335 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: WARNING keystonemiddleware.auth_token [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:39:48.429994 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: WARNING keystonemiddleware.auth_token [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:39:48.434528 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56010c9a59c0 pid: 111982 (default app) Aug 24 17:39:48.436006 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: WARNING keystonemiddleware.auth_token [None req-0c7387f1-d9fc-4769-be98-e2f137b35d4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:39:48.436664 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:39:48.437846 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001774 Aug 24 17:39:48.438259 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Wed Aug 24 17:39:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:39:48.441397 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56010c9a59c0 pid: 111981 (default app) Aug 24 17:41:05.479859 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:05.480868 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 24 17:41:05.481272 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:05.497317 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG dbcounter [-] [111981] Writing DB stats nova_api:SELECT=3 {{(pid=111981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:05.498165 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG dbcounter [-] [111981] Writing DB stats nova_cell0:SELECT=3 {{(pid=111981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:05.499039 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG dbcounter [-] [111981] Writing DB stats nova_cell1:SELECT=3 {{(pid=111981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:05.500163 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG dbcounter [-] [111981] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:06.366460 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-244e5beb-1b81-460f-abe3-6cea1b3a4deb admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:06.399876 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-244e5beb-1b81-460f-abe3-6cea1b3a4deb admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.911013 Aug 24 17:41:06.400656 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Aug 24 17:41:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:08.778457 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:08.779468 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-f65a9304-c3b9-4364-ac76-df12c502829e None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 24 17:41:08.780058 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:09.199732 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-a50a16a9-1b69-4a8b-8212-52dd2f2dd926 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "swap": 0}} {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:09.219268 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:41:09.219268 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: warnings.warn(msg) Aug 24 17:41:09.250412 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-a50a16a9-1b69-4a8b-8212-52dd2f2dd926 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.464484 Aug 24 17:41:09.251110 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 17:41:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:41:09.266010 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writing DB stats nova_api:SELECT=3 {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:09.266909 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writing DB stats nova_cell1:SELECT=3 {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:09.267726 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writing DB stats nova_cell0:SELECT=3 {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:09.268809 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:09.493632 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-ebda6427-adf7-4c22-9365-a5065a2044fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:09.496403 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:41:09.496403 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: warnings.warn(msg) Aug 24 17:41:09.559688 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-ebda6427-adf7-4c22-9365-a5065a2044fc admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.299572 Aug 24 17:41:09.560198 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 24 17:41:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:11.937517 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-a50a16a9-1b69-4a8b-8212-52dd2f2dd926 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:11.938549 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-a50a16a9-1b69-4a8b-8212-52dd2f2dd926 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 24 17:41:11.938951 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:12.594731 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-83a5d90f-4922-44fa-bdc9-2af0f1ae0f07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 512}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:12.614634 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:41:12.614634 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: warnings.warn(msg) Aug 24 17:41:12.636349 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-83a5d90f-4922-44fa-bdc9-2af0f1ae0f07 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.691136 Aug 24 17:41:12.637252 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 17:41:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:41:12.650880 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-8f6b01bd-c927-4a38-9cb0-a5edda17db17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:12.653866 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:41:12.653866 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: warnings.warn(msg) Aug 24 17:41:12.689299 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-8f6b01bd-c927-4a38-9cb0-a5edda17db17 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042763 Aug 24 17:41:12.690250 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 24 17:41:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:15.115722 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-83a5d90f-4922-44fa-bdc9-2af0f1ae0f07 admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:15.116732 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-83a5d90f-4922-44fa-bdc9-2af0f1ae0f07 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 24 17:41:15.117163 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:15.512742 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-646f2903-3db8-4951-a28b-741ef1555781 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0}} {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:15.532192 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-646f2903-3db8-4951-a28b-741ef1555781 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.408870 Aug 24 17:41:15.532754 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 17:41:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:41:15.545115 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-38638500-8570-490e-84d8-d7f85ce03b1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:15.569593 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-38638500-8570-490e-84d8-d7f85ce03b1e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028165 Aug 24 17:41:15.570294 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 24 17:41:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:17.950048 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-646f2903-3db8-4951-a28b-741ef1555781 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:17.951656 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-646f2903-3db8-4951-a28b-741ef1555781 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Aug 24 17:41:17.953448 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:18.395752 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-6d52d815-88ae-4a4f-8ab2-37ceec174e1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:18.417030 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-6d52d815-88ae-4a4f-8ab2-37ceec174e1d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457144 Aug 24 17:41:18.417889 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 17:41:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:41:18.429973 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-674e30aa-e4d1-4827-b87e-2bf6b9139f82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:18.455402 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-674e30aa-e4d1-4827-b87e-2bf6b9139f82 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029480 Aug 24 17:41:18.456867 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 24 17:41:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:20.816675 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-6d52d815-88ae-4a4f-8ab2-37ceec174e1d admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:20.817634 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-6d52d815-88ae-4a4f-8ab2-37ceec174e1d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Aug 24 17:41:20.818069 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:21.246349 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-ee8ea1b9-e34a-4b96-a11e-a3444507bc9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:21.266955 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-ee8ea1b9-e34a-4b96-a11e-a3444507bc9f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440993 Aug 24 17:41:21.267509 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 17:41:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:41:21.281029 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-8959837c-45f9-4dfd-a235-eec61f9a2fa6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:21.307841 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-8959837c-45f9-4dfd-a235-eec61f9a2fa6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030725 Aug 24 17:41:21.308850 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Aug 24 17:41:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:23.731971 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-ee8ea1b9-e34a-4b96-a11e-a3444507bc9f admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:23.733024 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-ee8ea1b9-e34a-4b96-a11e-a3444507bc9f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 24 17:41:23.733428 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:24.250211 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-5401ca4f-5279-4401-a66b-acafab0a8a7f admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:24.275138 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-5401ca4f-5279-4401-a66b-acafab0a8a7f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.535255 Aug 24 17:41:24.275714 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Aug 24 17:41:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:26.688518 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-ee8ea1b9-e34a-4b96-a11e-a3444507bc9f admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:26.689526 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-ee8ea1b9-e34a-4b96-a11e-a3444507bc9f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 24 17:41:26.689932 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:27.130366 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-da76ba97-61d3-453e-87d4-1a60ea78b296 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:27.149207 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-da76ba97-61d3-453e-87d4-1a60ea78b296 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.452569 Aug 24 17:41:27.149751 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 17:41:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:41:27.161882 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-467ddc52-e3f5-4ff7-9fe6-3cf094ab6745 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:27.187104 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-467ddc52-e3f5-4ff7-9fe6-3cf094ab6745 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029038 Aug 24 17:41:27.187720 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 24 17:41:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:29.540952 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-da76ba97-61d3-453e-87d4-1a60ea78b296 admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:29.541974 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-da76ba97-61d3-453e-87d4-1a60ea78b296 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 24 17:41:29.542379 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:29.909051 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-c5d0322f-d644-4bac-b6f2-c699831ebb9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "id": "2", "ram": 2048, "disk": 20}} {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:29.927116 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-c5d0322f-d644-4bac-b6f2-c699831ebb9b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.378788 Aug 24 17:41:29.927687 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 17:41:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:41:29.939856 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-1b78f842-5876-4282-bf0c-850d1f3e3351 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:29.964717 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-1b78f842-5876-4282-bf0c-850d1f3e3351 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028500 Aug 24 17:41:29.965281 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 24 17:41:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:32.330985 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-c5d0322f-d644-4bac-b6f2-c699831ebb9b admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:32.332777 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-c5d0322f-d644-4bac-b6f2-c699831ebb9b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002212 Aug 24 17:41:32.335802 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:32 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:32.767376 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-93cfb2ee-3162-4116-ab54-3786a8593e7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3"}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:32.792868 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-93cfb2ee-3162-4116-ab54-3786a8593e7c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.452565 Aug 24 17:41:32.793426 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 17:41:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:41:32.807972 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-aa1b0512-b00a-4652-82a6-85e77143cd8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:32.834151 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-aa1b0512-b00a-4652-82a6-85e77143cd8b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031931 Aug 24 17:41:32.835299 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 24 17:41:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:35.184794 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-93cfb2ee-3162-4116-ab54-3786a8593e7c admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:35.185714 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-93cfb2ee-3162-4116-ab54-3786a8593e7c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 24 17:41:35.186473 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:35.622059 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-b32a36ae-dd10-40cd-8fb4-778d487783c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "disk": 80}} {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:35.629302 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG dbcounter [-] [111981] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=111981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:35.644776 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-b32a36ae-dd10-40cd-8fb4-778d487783c9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.451757 Aug 24 17:41:35.645391 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 17:41:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:41:35.662876 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-8268d09c-80ef-4050-b6ce-0bc3efd1f5b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:35.690828 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-8268d09c-80ef-4050-b6ce-0bc3efd1f5b3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035891 Aug 24 17:41:35.691710 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 24 17:41:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:41:38.097469 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-b32a36ae-dd10-40cd-8fb4-778d487783c9 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:38.099106 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-b32a36ae-dd10-40cd-8fb4-778d487783c9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002183 Aug 24 17:41:38.099810 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:38.581884 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-52dbdeeb-0eab-4e45-a753-cc0bba950ee9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "disk": 160, "name": "m1.xlarge", "vcpus": 8, "id": "5"}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:38.605354 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-52dbdeeb-0eab-4e45-a753-cc0bba950ee9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.499491 Aug 24 17:41:38.606022 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Aug 24 17:41:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:41:38.618944 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-df639feb-eae7-4add-b784-b662d017a6b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:41:38.648310 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-df639feb-eae7-4add-b784-b662d017a6b4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033926 Aug 24 17:41:38.649404 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Aug 24 17:41:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:41:57.551020 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-52dbdeeb-0eab-4e45-a753-cc0bba950ee9 admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:57.552644 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-52dbdeeb-0eab-4e45-a753-cc0bba950ee9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002103 Aug 24 17:41:57.553045 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:57.563615 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG dbcounter [-] [111981] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=111981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:57.942451 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-a68d46ee-1ac2-4b56-b1d5-b37d2443438f admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:57.959895 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-a68d46ee-1ac2-4b56-b1d5-b37d2443438f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400695 Aug 24 17:41:57.960420 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Aug 24 17:41:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:59.010331 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-52dbdeeb-0eab-4e45-a753-cc0bba950ee9 admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:59.011342 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-52dbdeeb-0eab-4e45-a753-cc0bba950ee9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 24 17:41:59.011788 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 17:41:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:41:59.529457 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-5248bcb1-2381-4f36-bb4f-5d4c8a1bc124 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:59.534969 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.wsgi [None req-5248bcb1-2381-4f36-bb4f-5d4c8a1bc124 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-5248bcb1-2381-4f36-bb4f-5d4c8a1bc124 admin admin] Request method failure captured: Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Accept: application/json Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Accept-Encoding: gzip, deflate Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Connection: keep-alive Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Content-Length: 0 Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Host: 10.222.0.27 Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Openstack-Api-Version: compute 2.90 Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Openstack-System-Scope: None Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: User-Agent: python-novaclient Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Auth-Token: gAAAAABjBmLmy5U3sTZYyEOsGiV7aieNLEqdrxxX1IalaCNRYjzCQuf0YRgxbwJVCiiYyfTYqpcjq80fZo1g2RejgyPgmU7QFkpwUSbqXPr2kdYH_E0sUZ_sVMA5RQ5iCTXYa2KvMQzstD7S0HDES9k4-OtAnwDiOYP3AtkGCmtD0iywneTXXfU Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Domain-Id: None Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Domain-Name: None Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Identity-Status: Confirmed Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Is-Admin-Project: True Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Project-Domain-Id: default Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Project-Domain-Name: Default Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Project-Id: c0a52b9c017649d7b6608817068a47f8 Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Project-Name: admin Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Role: admin,reader,member Aug 24 17:41:59.538924 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Roles: admin,reader,member Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0a52b9c017649d7b6608817068a47f8"}]}] Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Tenant: admin Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Tenant-Id: c0a52b9c017649d7b6608817068a47f8 Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Tenant-Name: admin Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User: admin Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User-Domain-Id: default Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User-Domain-Name: Default Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User-Id: 6c7d397143574599b62017bc352e1183 Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User-Name: admin Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: method: > Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: exception: Flavor 42 could not be found. Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: action_args: {'id': '42'} Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:41:59.540642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:41:59.541669 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:41:59.543297 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-5248bcb1-2381-4f36-bb4f-5d4c8a1bc124 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:41:59.544719 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-5248bcb1-2381-4f36-bb4f-5d4c8a1bc124 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390517 Aug 24 17:41:59.544719 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Aug 24 17:41:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:41:59.549880 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-4e061364-415f-4e23-aa42-64ff5514967e admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:59.554125 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:41:59.573351 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-4e061364-415f-4e23-aa42-64ff5514967e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026884 Aug 24 17:41:59.574149 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 24 17:41:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:59.584779 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-e689a72a-787f-4c78-9851-ef64437b202d admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:59.608946 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-e689a72a-787f-4c78-9851-ef64437b202d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028673 Aug 24 17:41:59.609502 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 24 17:41:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:41:59.619572 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-4d475822-96e1-4ed4-968a-80feb0dc1d17 admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:41:59.625927 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.wsgi [None req-4d475822-96e1-4ed4-968a-80feb0dc1d17 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-4d475822-96e1-4ed4-968a-80feb0dc1d17 admin admin] Request method failure captured: Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Accept: application/json Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Accept-Encoding: gzip, deflate Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Connection: keep-alive Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Content-Length: 0 Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Host: 10.222.0.27 Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Openstack-Api-Version: compute 2.90 Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Openstack-System-Scope: None Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: User-Agent: python-novaclient Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Auth-Token: gAAAAABjBmLmy5U3sTZYyEOsGiV7aieNLEqdrxxX1IalaCNRYjzCQuf0YRgxbwJVCiiYyfTYqpcjq80fZo1g2RejgyPgmU7QFkpwUSbqXPr2kdYH_E0sUZ_sVMA5RQ5iCTXYa2KvMQzstD7S0HDES9k4-OtAnwDiOYP3AtkGCmtD0iywneTXXfU Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Domain-Id: None Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Domain-Name: None Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Identity-Status: Confirmed Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Is-Admin-Project: True Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Project-Domain-Id: default Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Project-Domain-Name: Default Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Project-Id: c0a52b9c017649d7b6608817068a47f8 Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Project-Name: admin Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Role: admin,reader,member Aug 24 17:41:59.629806 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Roles: admin,reader,member Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0a52b9c017649d7b6608817068a47f8"}]}] Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Tenant: admin Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Tenant-Id: c0a52b9c017649d7b6608817068a47f8 Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Tenant-Name: admin Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User: admin Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User-Domain-Id: default Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User-Domain-Name: Default Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User-Id: 6c7d397143574599b62017bc352e1183 Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User-Name: admin Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: method: > Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: exception: Flavor 42 could not be found. Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: action_args: {'id': '42'} Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:41:59.631317 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:41:59.632248 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:41:59.633559 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-4d475822-96e1-4ed4-968a-80feb0dc1d17 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:41:59.634744 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-4d475822-96e1-4ed4-968a-80feb0dc1d17 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015289 Aug 24 17:41:59.634744 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Aug 24 17:41:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:00.601631 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-e689a72a-787f-4c78-9851-ef64437b202d admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:00.602643 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-e689a72a-787f-4c78-9851-ef64437b202d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 24 17:42:00.603038 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:01.127162 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-cb000541-8642-4340-8946-474ae235a43f admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:01.136287 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.wsgi [None req-cb000541-8642-4340-8946-474ae235a43f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-cb000541-8642-4340-8946-474ae235a43f admin admin] Request method failure captured: Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Accept: application/json Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Accept-Encoding: gzip, deflate Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Connection: keep-alive Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Content-Length: 0 Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Host: 10.222.0.27 Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Openstack-Api-Version: compute 2.90 Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Openstack-System-Scope: None Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: User-Agent: python-novaclient Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Auth-Token: gAAAAABjBmLoW4EOJvF1ZE4vvnkJD4OxlOJiLPkZg94lX9SljZ58y9-1dPTG931aT_NuEiE1DLRa0SSn8-FZZ8zB2hgK8gxfgmyXy0evAP-gmP44klMBmiuWoiwsHbV_EzrnDuTVWsr3kn1zqq9JvGtjfYkjHcPr-GcmESFf3zvAt7bphWCY2lA Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Domain-Id: None Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Domain-Name: None Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Identity-Status: Confirmed Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Is-Admin-Project: True Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Project-Domain-Id: default Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Project-Domain-Name: Default Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Project-Id: c0a52b9c017649d7b6608817068a47f8 Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Project-Name: admin Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Role: admin,reader,member Aug 24 17:42:01.137857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Roles: admin,reader,member Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0a52b9c017649d7b6608817068a47f8"}]}] Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Tenant: admin Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Tenant-Id: c0a52b9c017649d7b6608817068a47f8 Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Tenant-Name: admin Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User: admin Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User-Domain-Id: default Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User-Domain-Name: Default Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User-Id: 6c7d397143574599b62017bc352e1183 Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User-Name: admin Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: method: > Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: exception: Flavor 84 could not be found. Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: action_args: {'id': '84'} Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:01.139203 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:01.140184 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:42:01.142212 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-cb000541-8642-4340-8946-474ae235a43f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:01.143676 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-cb000541-8642-4340-8946-474ae235a43f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397520 Aug 24 17:42:01.143676 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Aug 24 17:42:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:01.150178 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-79c74ab0-9a3e-4695-87c6-66a16749a4b6 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:01.165872 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-79c74ab0-9a3e-4695-87c6-66a16749a4b6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019213 Aug 24 17:42:01.166403 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 24 17:42:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:42:01.176324 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-6b305252-16e3-419c-b379-33c778815ac3 admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:01.190946 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-6b305252-16e3-419c-b379-33c778815ac3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018631 Aug 24 17:42:01.192048 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 24 17:42:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:42:01.201003 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-90772f19-8989-403b-92b3-4330ddb01fdc admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:01.206187 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.wsgi [None req-90772f19-8989-403b-92b3-4330ddb01fdc admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-90772f19-8989-403b-92b3-4330ddb01fdc admin admin] Request method failure captured: Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Accept: application/json Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Accept-Encoding: gzip, deflate Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Connection: keep-alive Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Content-Length: 0 Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Host: 10.222.0.27 Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Openstack-Api-Version: compute 2.90 Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Openstack-System-Scope: None Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: User-Agent: python-novaclient Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Auth-Token: gAAAAABjBmLoW4EOJvF1ZE4vvnkJD4OxlOJiLPkZg94lX9SljZ58y9-1dPTG931aT_NuEiE1DLRa0SSn8-FZZ8zB2hgK8gxfgmyXy0evAP-gmP44klMBmiuWoiwsHbV_EzrnDuTVWsr3kn1zqq9JvGtjfYkjHcPr-GcmESFf3zvAt7bphWCY2lA Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Domain-Id: None Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Domain-Name: None Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Identity-Status: Confirmed Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Is-Admin-Project: True Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Project-Domain-Id: default Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Project-Domain-Name: Default Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Project-Id: c0a52b9c017649d7b6608817068a47f8 Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Project-Name: admin Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Role: admin,reader,member Aug 24 17:42:01.207744 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Roles: admin,reader,member Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0a52b9c017649d7b6608817068a47f8"}]}] Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Tenant: admin Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Tenant-Id: c0a52b9c017649d7b6608817068a47f8 Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Tenant-Name: admin Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User: admin Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User-Domain-Id: default Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User-Domain-Name: Default Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User-Id: 6c7d397143574599b62017bc352e1183 Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User-Name: admin Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: method: > Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: exception: Flavor 84 could not be found. Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: action_args: {'id': '84'} Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:01.209270 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:01.210435 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:42:01.211875 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-90772f19-8989-403b-92b3-4330ddb01fdc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:01.213105 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-90772f19-8989-403b-92b3-4330ddb01fdc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011538 Aug 24 17:42:01.213105 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Aug 24 17:42:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:02.197190 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-6b305252-16e3-419c-b379-33c778815ac3 admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:02.198313 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-6b305252-16e3-419c-b379-33c778815ac3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 24 17:42:02.198707 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:02.723760 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-a4d20db2-e6a0-4bc6-b3ad-7921e12a44f5 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:02.729821 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.wsgi [None req-a4d20db2-e6a0-4bc6-b3ad-7921e12a44f5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-a4d20db2-e6a0-4bc6-b3ad-7921e12a44f5 admin admin] Request method failure captured: Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Accept: application/json Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Accept-Encoding: gzip, deflate Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Connection: keep-alive Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Content-Length: 0 Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Host: 10.222.0.27 Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Openstack-Api-Version: compute 2.90 Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Openstack-System-Scope: None Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: User-Agent: python-novaclient Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Auth-Token: gAAAAABjBmLqF1xFzH9DbgjQZehFOcvjw5yfgsQfbV9VWCM1-sKT-2Y4giqGc2H7jjN_0WIuDT3XnOWGf9UBcoXvkFMaEoG6-ekCUyi9_bgL4FmXL8gk2atPnG53K9msIabZtWBL9vYsCNb6UgpRJsloOimxIoWzKjV1HQfGrE8PieTtrdX9gkA Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Domain-Id: None Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Domain-Name: None Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Identity-Status: Confirmed Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Is-Admin-Project: True Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Project-Domain-Id: default Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Project-Domain-Name: Default Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Project-Id: c0a52b9c017649d7b6608817068a47f8 Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Project-Name: admin Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Role: admin,reader,member Aug 24 17:42:02.731306 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Roles: admin,reader,member Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0a52b9c017649d7b6608817068a47f8"}]}] Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Tenant: admin Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Tenant-Id: c0a52b9c017649d7b6608817068a47f8 Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-Tenant-Name: admin Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User: admin Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User-Domain-Id: default Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User-Domain-Name: Default Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User-Id: 6c7d397143574599b62017bc352e1183 Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: X-User-Name: admin Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: method: > Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: exception: Flavor 451 could not be found. Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: action_args: {'id': '451'} Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:02.732847 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:02.733868 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: ERROR nova.api.openstack.wsgi Aug 24 17:42:02.735144 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-a4d20db2-e6a0-4bc6-b3ad-7921e12a44f5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:02.736439 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-a4d20db2-e6a0-4bc6-b3ad-7921e12a44f5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395271 Aug 24 17:42:02.736439 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 24 17:42:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:02.742879 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-e7e4247d-977a-491a-afb5-76d68fcd575e admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:02.757407 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-e7e4247d-977a-491a-afb5-76d68fcd575e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018004 Aug 24 17:42:02.757928 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 24 17:42:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:42:02.767368 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:02.781917 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018256 Aug 24 17:42:02.782450 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Aug 24 17:42:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:42:02.791921 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-148a52db-d3e9-4eb1-962b-dac2ae5debb5 admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:02.797207 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.wsgi [None req-148a52db-d3e9-4eb1-962b-dac2ae5debb5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-148a52db-d3e9-4eb1-962b-dac2ae5debb5 admin admin] Request method failure captured: Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Accept: application/json Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Accept-Encoding: gzip, deflate Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Connection: keep-alive Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Content-Length: 0 Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Host: 10.222.0.27 Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Openstack-Api-Version: compute 2.90 Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Openstack-System-Scope: None Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: User-Agent: python-novaclient Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Auth-Token: gAAAAABjBmLqF1xFzH9DbgjQZehFOcvjw5yfgsQfbV9VWCM1-sKT-2Y4giqGc2H7jjN_0WIuDT3XnOWGf9UBcoXvkFMaEoG6-ekCUyi9_bgL4FmXL8gk2atPnG53K9msIabZtWBL9vYsCNb6UgpRJsloOimxIoWzKjV1HQfGrE8PieTtrdX9gkA Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Domain-Id: None Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Domain-Name: None Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Identity-Status: Confirmed Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Is-Admin-Project: True Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Project-Domain-Id: default Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Project-Domain-Name: Default Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Project-Id: c0a52b9c017649d7b6608817068a47f8 Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Project-Name: admin Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Role: admin,reader,member Aug 24 17:42:02.798691 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Roles: admin,reader,member Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0a52b9c017649d7b6608817068a47f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0a52b9c017649d7b6608817068a47f8"}]}] Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Tenant: admin Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Tenant-Id: c0a52b9c017649d7b6608817068a47f8 Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-Tenant-Name: admin Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User: admin Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User-Domain-Id: default Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User-Domain-Name: Default Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User-Id: 6c7d397143574599b62017bc352e1183 Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: X-User-Name: admin Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: method: > Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: exception: Flavor 451 could not be found. Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: action_args: {'id': '451'} Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:42:02.800392 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:02.801923 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: ERROR nova.api.openstack.wsgi Aug 24 17:42:02.803024 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-148a52db-d3e9-4eb1-962b-dac2ae5debb5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:42:02.804104 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-148a52db-d3e9-4eb1-962b-dac2ae5debb5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011626 Aug 24 17:42:02.804104 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 24 17:42:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 17:42:03.768944 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:03.769996 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 24 17:42:03.770387 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:04.295453 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-4e03bdf7-4936-4c53-a07b-43faee31eb8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:04.314362 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-4e03bdf7-4936-4c53-a07b-43faee31eb8c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.407133 Aug 24 17:42:04.314914 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Aug 24 17:42:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:05.291964 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:05.293481 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Aug 24 17:42:05.294046 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:05.815159 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-8d418195-3ca9-4512-8bdc-d353571b1fba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:05.833096 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-8d418195-3ca9-4512-8bdc-d353571b1fba admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.398464 Aug 24 17:42:05.833628 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Aug 24 17:42:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:06.793852 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:06.794851 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 24 17:42:06.795244 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:07.324724 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-f715bcda-67e9-4cae-af0a-429e7d5160a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:07.343430 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-f715bcda-67e9-4cae-af0a-429e7d5160a3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.405598 Aug 24 17:42:07.343996 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Aug 24 17:42:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:08.309243 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:08.310329 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Aug 24 17:42:08.310724 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:08.838076 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-f82cf873-517e-4674-aeb3-5b4d10ffaa8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:42:08.856445 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-f82cf873-517e-4674-aeb3-5b4d10ffaa8f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.401789 Aug 24 17:42:08.856983 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Aug 24 17:42:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:42:09.825909 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:09.826938 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 17:42:09.827326 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 17:42:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:42:10.349857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-68d12c28-b87f-443c-a9b9-bb43b6af19bd admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:42:10.374238 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-68d12c28-b87f-443c-a9b9-bb43b6af19bd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409966 Aug 24 17:42:10.374952 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Wed Aug 24 17:42:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:43:03.562900 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:03.564000 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-07f51e04-90c3-4d24-a4b3-ba336884c229 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Aug 24 17:43:03.564402 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Wed Aug 24 17:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:43:03.575410 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:03.957456 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-f109ebdb-15a0-4412-8aef-532987efb13f admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:03.977718 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-f109ebdb-15a0-4412-8aef-532987efb13f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406720 Aug 24 17:43:03.978252 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Aug 24 17:43:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:43:03.999610 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG dbcounter [-] [111981] Writing DB stats nova_api:SELECT=14 {{(pid=111981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:43:04.003797 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-8e189a03-3ee0-427d-bd9b-477fcad2d0e4 admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:04.012142 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-8e189a03-3ee0-427d-bd9b-477fcad2d0e4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013959 Aug 24 17:43:04.012658 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Wed Aug 24 17:43:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:04.024237 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-72d318b7-940d-43be-bc4e-2623509df99e admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:04.031699 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-72d318b7-940d-43be-bc4e-2623509df99e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011022 Aug 24 17:43:04.032209 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Wed Aug 24 17:43:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:04.043258 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-d161e7f6-c437-478f-803c-2ad19b27733e admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:04.050642 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-d161e7f6-c437-478f-803c-2ad19b27733e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010680 Aug 24 17:43:04.051151 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Wed Aug 24 17:43:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:43:04.062763 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-41aa3bbe-1634-49f8-ad47-83f3da0342a6 admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:43:04.070777 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-41aa3bbe-1634-49f8-ad47-83f3da0342a6 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011494 Aug 24 17:43:04.071289 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Wed Aug 24 17:43:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:45:59.316295 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-d161e7f6-c437-478f-803c-2ad19b27733e admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:59.317310 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-d161e7f6-c437-478f-803c-2ad19b27733e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 24 17:45:59.317710 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 17:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:45:59.456940 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writing DB stats nova_api:SELECT=6 {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:45:59.616272 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-67ce5503-e9be-44c9-87f6-24d8e098479d admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:45:59.618591 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:45:59.618591 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: warnings.warn(msg) Aug 24 17:45:59.619719 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-67ce5503-e9be-44c9-87f6-24d8e098479d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:59.620194 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-67ce5503-e9be-44c9-87f6-24d8e098479d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:59.620621 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-67ce5503-e9be-44c9-87f6-24d8e098479d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:59.621328 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-67ce5503-e9be-44c9-87f6-24d8e098479d admin admin] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:45:59.621772 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-67ce5503-e9be-44c9-87f6-24d8e098479d admin admin] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:45:59.622185 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-67ce5503-e9be-44c9-87f6-24d8e098479d admin admin] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:45:59.656155 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-67ce5503-e9be-44c9-87f6-24d8e098479d admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200684 Aug 24 17:45:59.656706 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 24 17:45:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:46:00.483613 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-d161e7f6-c437-478f-803c-2ad19b27733e admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:00.484640 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-d161e7f6-c437-478f-803c-2ad19b27733e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 24 17:46:00.485036 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 17:46:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:00.687061 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-3e5adf33-7719-4b36-9366-940eb42bded0 admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:00.689427 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:46:00.689427 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: warnings.warn(msg) Aug 24 17:46:00.690528 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-3e5adf33-7719-4b36-9366-940eb42bded0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:00.691003 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-3e5adf33-7719-4b36-9366-940eb42bded0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:00.691432 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-3e5adf33-7719-4b36-9366-940eb42bded0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:00.692812 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-3e5adf33-7719-4b36-9366-940eb42bded0 admin admin] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:00.693210 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-3e5adf33-7719-4b36-9366-940eb42bded0 admin admin] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:00.693630 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-3e5adf33-7719-4b36-9366-940eb42bded0 admin admin] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:00.714446 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-3e5adf33-7719-4b36-9366-940eb42bded0 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078747 Aug 24 17:46:00.714999 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 24 17:46:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:46:11.897150 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-d161e7f6-c437-478f-803c-2ad19b27733e admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:11.898195 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-d161e7f6-c437-478f-803c-2ad19b27733e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 24 17:46:11.898626 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 17:46:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:12.044517 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writing DB stats nova_cell0:SELECT=4 {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:12.045224 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writing DB stats nova_cell1:SELECT=4 {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:12.046018 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG dbcounter [-] [111982] Writing DB stats nova_api:SELECT=8 {{(pid=111982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:46:12.094652 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-d5034ec2-ea8f-4ba4-9245-397b896e0972 admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:12.097270 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:46:12.097270 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: warnings.warn(msg) Aug 24 17:46:12.098352 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-d5034ec2-ea8f-4ba4-9245-397b896e0972 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:12.098826 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-d5034ec2-ea8f-4ba4-9245-397b896e0972 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:12.099249 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-d5034ec2-ea8f-4ba4-9245-397b896e0972 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:12.100009 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-d5034ec2-ea8f-4ba4-9245-397b896e0972 admin admin] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:12.100454 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-d5034ec2-ea8f-4ba4-9245-397b896e0972 admin admin] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:12.100868 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-d5034ec2-ea8f-4ba4-9245-397b896e0972 admin admin] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:12.125275 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-d5034ec2-ea8f-4ba4-9245-397b896e0972 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085085 Aug 24 17:46:12.125809 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 24 17:46:12 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:46:12.941401 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: DEBUG nova.api.openstack.wsgi [None req-d161e7f6-c437-478f-803c-2ad19b27733e admin admin] Calling method '>' {{(pid=111981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:12.942396 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: INFO nova.api.openstack.requestlog [None req-d161e7f6-c437-478f-803c-2ad19b27733e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 24 17:46:12.942791 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: [pid: 111981|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Aug 24 17:46:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:46:13.130815 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG nova.api.openstack.wsgi [None req-f611ae4d-2c81-4a32-a5c7-9b557377123d admin admin] Calling method '>' {{(pid=111982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:46:13.133818 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:46:13.133818 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: warnings.warn(msg) Aug 24 17:46:13.134906 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-f611ae4d-2c81-4a32-a5c7-9b557377123d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:13.135384 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-f611ae4d-2c81-4a32-a5c7-9b557377123d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:13.135835 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-f611ae4d-2c81-4a32-a5c7-9b557377123d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:13.136545 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-f611ae4d-2c81-4a32-a5c7-9b557377123d admin admin] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:46:13.136995 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-f611ae4d-2c81-4a32-a5c7-9b557377123d admin admin] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:46:13.137411 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: DEBUG oslo_concurrency.lockutils [None req-f611ae4d-2c81-4a32-a5c7-9b557377123d admin admin] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:46:13.158388 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: INFO nova.api.openstack.requestlog [None req-f611ae4d-2c81-4a32-a5c7-9b557377123d admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077885 Aug 24 17:46:13.158857 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: [pid: 111982|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Aug 24 17:46:13 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:47:09.741491 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: Wed Aug 24 17:47:09 2022 - graceful shutdown triggered... Aug 24 17:47:09.741996 dv-cinder-840525-3-iscsi devstack@n-api.service[111982]: Gracefully killing worker 2 (pid: 111982)... Aug 24 17:47:09.741731 dv-cinder-840525-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 17:47:09.742797 dv-cinder-840525-3-iscsi devstack@n-api.service[111981]: Gracefully killing worker 1 (pid: 111981)... Aug 24 17:47:10.742633 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: worker 1 buried after 1 seconds Aug 24 17:47:10.743092 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: worker 2 buried after 1 seconds Aug 24 17:47:10.743092 dv-cinder-840525-3-iscsi devstack@n-api.service[111980]: goodbye to uWSGI. Aug 24 17:47:10.744276 dv-cinder-840525-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 17:47:10.744817 dv-cinder-840525-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 17:47:10.748232 dv-cinder-840525-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 17:47:10.757510 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 17:47:10 2022] *** Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: nodename: dv-cinder-840525-3-iscsi Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: machine: x86_64 Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: clock source: unix Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: pcre jit disabled Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: detected number of CPU cores: 4 Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: current working directory: / Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: detected binary path: /usr/bin/uwsgi-core Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: your processes number limit is 47680 Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: your memory page size is 4096 bytes Aug 24 17:47:10.759526 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: detected max file descriptor number: 2048 Aug 24 17:47:10.760359 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: lock engine: pthread robust mutexes Aug 24 17:47:10.760359 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: thunder lock: enabled Aug 24 17:47:10.760359 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 17:47:10.760359 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 17:47:10.800332 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: Python main interpreter initialized at 0x55a4be1029c0 Aug 24 17:47:10.800332 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: python threads support enabled Aug 24 17:47:10.800332 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: your server socket listen backlog is limited to 100 connections Aug 24 17:47:10.800332 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: your mercy for graceful operations on workers is 90 seconds Aug 24 17:47:10.800720 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 17:47:10.800720 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: *** Operational MODE: preforking *** Aug 24 17:47:10.800973 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: *** uWSGI is running in multiple interpreter mode *** Aug 24 17:47:10.801140 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: spawned uWSGI master process (pid: 126977) Aug 24 17:47:10.801483 dv-cinder-840525-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 17:47:10.802367 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: spawned uWSGI worker 1 (pid: 126993, cores: 1) Aug 24 17:47:10.802858 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: spawned uWSGI worker 2 (pid: 126994, cores: 1) Aug 24 17:47:10.820107 dv-cinder-840525-3-iscsi devstack@n-api.service[126977]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 17:47:11.467740 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:47:11.473306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 17:47:12.617072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:47:12.617072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: from cryptography.utils import int_from_bytes Aug 24 17:47:12.617705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:47:12.617705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: from cryptography.utils import int_from_bytes Aug 24 17:47:12.631814 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:47:12.631814 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: from cryptography.utils import int_from_bytes Aug 24 17:47:12.632269 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 17:47:12.632269 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: from cryptography.utils import int_from_bytes Aug 24 17:47:15.021106 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:47:15.021829 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:47:15.022108 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:47:15.022590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:47:15.022760 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:47:15.023069 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.023528 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.023851 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.024298 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.024700 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.025101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.025472 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.025806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.026234 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.026562 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.027034 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.027893 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840525-3-iscsi {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.028273 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.028614 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.029032 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.029346 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.029698 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.030056 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.030528 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840525-3-iscsi {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.038927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.039460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.039460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.039460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.039460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.039460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.039460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.039460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.039460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.040200 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.040200 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.040200 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.040200 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.040456 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.040704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.041204 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.041741 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.042221 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.042712 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.043640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.044168 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.044540 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.044879 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.045141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.045405 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.045856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.046045 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.046361 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.046676 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.046988 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.047302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.047638 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.047952 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.048275 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.048571 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.048897 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.049222 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.049550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.049869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.050183 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.050615 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.050871 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.051180 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.051563 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.051877 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.052191 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.052513 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.052836 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.053145 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.053454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.053761 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.054083 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.054416 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.054722 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.054977 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.055278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.055611 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.055936 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.056245 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.056554 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.056861 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.057161 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.057468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.057774 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.058082 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.058390 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.058728 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.059034 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.059342 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.059688 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.059997 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.060320 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.060643 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.060952 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.061282 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.061574 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.061881 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.062204 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.062514 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.062821 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.063148 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.063454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.063786 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.064104 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.064417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.064723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.065043 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.065343 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.065649 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.065969 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.066277 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.066578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.066882 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.067188 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.070985 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.070985 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.070985 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.070985 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.070985 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.070985 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.070985 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.070985 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.073072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.073072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.073072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.073072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.073072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.073072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.073072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.073072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.074550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.074550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.074550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.074550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.074550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.074550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.074550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.075651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.075651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.075651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.075651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.076106 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.076201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.076459 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.076773 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.077094 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.077426 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.077750 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.078065 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.078406 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.078752 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.079066 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.079392 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.079743 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.080057 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.080370 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.080683 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.081007 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.081342 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.081674 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.081981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.082098 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 17:47:15.082529 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.082638 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 17:47:15.082736 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.082874 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 17:47:15.082982 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.083189 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.083359 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 17:47:15.083572 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 17:47:15.083717 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.083874 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.084016 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.084157 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.084306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.084449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.084604 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.084747 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.084894 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.085051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.085254 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.085353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.085576 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.085673 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.085900 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.085996 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.086223 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.086319 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.086527 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.086621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.086801 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.086909 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.087120 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.087216 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.087422 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.087551 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840525-3-iscsi {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.087773 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.087936 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.088084 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.088182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.088378 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.088481 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.088698 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.088809 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.089002 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.089105 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.089315 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.089417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.089618 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.090244 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.090467 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.090685 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.090827 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.091000 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.091137 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.091306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.091425 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.091735 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.092027 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.092130 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.092233 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.092321 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.092497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.092615 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.092758 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.092905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.093085 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.093254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.093408 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.093560 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.093709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.093864 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.094014 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.094167 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.094388 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840525-3-iscsi {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.094544 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.094700 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.094850 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.094993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.095145 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.095295 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.095437 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.095639 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.096000 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.096212 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.096317 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.096549 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.096654 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.096882 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.096984 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.097188 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.097284 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.097515 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.097659 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.097823 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.097922 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.098138 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.098273 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.098459 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.098627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.098756 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.099046 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.099351 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.099593 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.099758 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.099923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.100080 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.100242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.100389 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.100535 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.100702 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.100869 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.101025 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.101180 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.101327 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.101474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.101631 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.101786 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.101953 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.102257 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.102416 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.102590 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.102827 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.102986 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.103249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.103406 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.103619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.103778 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.103936 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.104092 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.104241 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.104394 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.104552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.104712 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.104861 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.105005 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.105108 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.105208 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.105208 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.106080 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.106255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.106369 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.106466 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.106553 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.106637 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.106828 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.106986 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.107090 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.107178 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.107263 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.107415 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.107665 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.107769 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.107907 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.107997 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.108090 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.108177 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.108325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.108424 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.108518 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.108784 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.108940 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.109044 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.109140 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.109328 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.109424 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.109666 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.109773 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.109984 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.110093 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.110292 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.110395 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.110646 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.110832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.110990 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.111107 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.111229 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.111327 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.111588 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.111735 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.111866 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.111971 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.112337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.112496 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.112607 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.112696 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.112808 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.112898 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.113032 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.113164 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.113336 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.113445 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.113642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.113750 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.113962 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.114072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.114267 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.114379 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.114575 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.114680 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.114884 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.115355 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.115355 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.115713 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.115814 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.115912 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.116005 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.116125 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.116263 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.116719 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.116830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.116926 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.117019 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.117106 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.117197 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.117293 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.117379 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.117464 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.117587 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.117673 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.117835 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.117933 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.118158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.118325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.118509 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.118753 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.118914 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.119070 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.119226 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.119354 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.119438 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.119539 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.119671 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.119767 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.120005 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.120197 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.120295 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.120381 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.120591 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.120687 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.120913 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.121060 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.121247 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.121352 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.121547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.121647 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.121860 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.121970 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.122166 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.122274 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.122517 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.122606 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.122777 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.122891 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.123078 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.123193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.123390 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.123536 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.123722 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.123858 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.124046 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.124168 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.124358 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.124461 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.124664 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.124759 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.124976 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.125127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.125264 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.125354 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.125607 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.125712 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.125917 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.126020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.126221 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.126317 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.126520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.126616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.126839 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.126935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.127145 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.127249 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.127457 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.127596 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.127789 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.127891 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.128096 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.128201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.128416 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.128510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 17:47:15.128732 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.128835 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.129042 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.129151 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.129353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.129449 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.129665 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.129767 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.129975 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.130079 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.130284 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.130379 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.130610 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.130729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.130920 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.131033 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.131232 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.131347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.131594 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.131699 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.131907 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.132021 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.132223 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.132325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.132541 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.132710 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.132866 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.133117 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.133262 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.133455 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.133703 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.133860 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.134018 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.134168 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.134341 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.134502 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.134658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.134809 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.134957 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.135107 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.135248 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.135396 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.135559 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.135708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.135852 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.136002 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.136112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.136282 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.136387 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.136604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.136699 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.136915 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.137025 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.137230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.137334 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.137538 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.137632 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.137844 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.137949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.138150 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.138245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.138463 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.138558 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.138768 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.138876 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.139113 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.139230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.139377 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.139560 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.139710 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.139919 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.140016 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.140235 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.140330 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.140554 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.140693 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.140870 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.140977 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.141184 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.141290 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.141497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.141616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.141808 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.141910 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.142114 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.142225 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.142420 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.142604 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.142831 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.142956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.143054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.143148 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.143990 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.144121 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.144208 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.144282 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.144354 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.144424 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.144518 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.144629 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.144718 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.144869 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.145176 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.145546 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.145812 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.146143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.146454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.146695 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.146801 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.147040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.147137 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.147543 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.147863 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.148180 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.148399 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.148512 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.148739 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.148847 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.149071 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.149185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.149387 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.149490 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.149714 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.149810 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.150029 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.150132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.150337 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.150446 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.150659 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.150768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.150965 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.151068 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.151270 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.151375 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.151615 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.151808 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.151979 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.152139 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.152914 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.153089 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.153226 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.153324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.153429 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.153517 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.153741 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.153844 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.153976 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.154082 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.154308 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.154409 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.154612 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.154828 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.154954 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.155166 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.155320 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.155465 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.155665 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.155807 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.155949 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.156127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.156274 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.156422 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.156575 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.156724 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.156876 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.157030 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.157180 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.157336 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.157478 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.157625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.157765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.157912 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.158054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.158209 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.158358 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.158508 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.158656 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.158809 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.158966 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.159124 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.159266 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.159415 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.159588 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.159709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.159811 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.159993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.160100 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.160304 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.160424 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.160610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.160716 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.160914 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.161024 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.161220 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.161314 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.161524 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.161632 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.161836 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.161990 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.162142 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.162246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.162453 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.162568 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.162757 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.162851 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.163126 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.163347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.163529 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.163686 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.163838 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.164000 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.164138 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.164243 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.164340 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.164427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.164602 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.164706 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.164909 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.165004 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.165218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.165314 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.165527 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.165629 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.165867 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.165977 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.166171 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.166266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.166500 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.166601 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.166813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.166915 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.167135 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.167231 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.167440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.167583 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.167784 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.167942 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.168655 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.168756 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.168978 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.169076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.169289 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.169425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.169608 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.169702 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.169921 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.170022 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.170234 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.170342 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.170542 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.170665 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.170848 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.170979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.171172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.171279 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.171509 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.171609 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.171821 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.171915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.172145 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.172248 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.172470 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.172571 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.172796 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.172898 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.173100 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.173208 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.173411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.173527 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.173721 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.173816 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.174030 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.174133 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.174337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.174445 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.174647 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.174743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.174957 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.175053 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.175271 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.175361 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.175605 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.175718 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.175921 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.176017 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.176235 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.176329 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.176540 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.176706 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.176852 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.176945 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.177162 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.177291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.177463 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.177583 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.177772 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.177877 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.179068 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.179169 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.179256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.179342 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.179424 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.179623 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.179725 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.179826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.179929 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.180036 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.180132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.180132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.180288 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.180611 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.180919 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.181231 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.181536 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.181689 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.181850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.181981 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.182168 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.182299 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.182477 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.182583 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.182858 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.182953 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.183191 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.183295 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.183541 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.183668 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.183863 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.183993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.184174 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.184356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.184506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.184650 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.184790 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.185020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.185172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.185323 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.185464 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.185603 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.185747 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.185903 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.186046 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.186196 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.186352 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.186504 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.186648 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.186805 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.186950 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.187123 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.187292 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.187444 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.187638 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.187947 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.188367 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.188680 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.188992 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.189316 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.189641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.189966 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.190274 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.190661 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.190897 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.191224 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.191575 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.191891 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.191975 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.192207 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.192339 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.192515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.192841 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.193068 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.193163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.193466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.193753 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.193870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.194194 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.194444 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.194540 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.194819 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.195048 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.195158 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.195460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.195792 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.195901 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.196174 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.196411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.196720 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.196844 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.197027 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.197354 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.197461 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.197658 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.197959 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.198057 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.198269 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.198556 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.198659 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.198874 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.199146 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.199253 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.199541 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.199793 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.199890 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.200160 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.200440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.200544 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.200789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.200991 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.201111 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.201418 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.201627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.201800 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.202040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.202163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.202346 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.202935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.203114 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.203259 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.203662 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.203894 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.204036 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.204281 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.204612 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.204754 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.204941 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.205207 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.205355 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.205575 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.205840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.205986 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.206292 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.206446 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.206596 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.206933 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.207078 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.207220 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.207376 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.207634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.207786 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.207928 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.208069 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.208353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.208488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.208658 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.208893 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.209029 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.209257 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.209544 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.209691 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.209851 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.210045 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.210181 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.210468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.210612 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.210864 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.211009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.211149 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.211395 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.211550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.211728 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.211907 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.212043 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.212350 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.212490 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.212654 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.212845 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.212991 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.213278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.213412 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.213601 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.213920 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.214072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.214229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.214430 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.214572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.215376 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.215552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.215737 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.215973 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.216119 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.216425 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.216673 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.217076 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.217220 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.217355 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.217548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.217766 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.218005 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.218165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.218455 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.218592 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.218805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.218975 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.219122 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.219423 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.219613 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.219755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.219962 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.220099 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.220371 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.220514 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.220684 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.221144 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.221281 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.221552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.221699 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.221882 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.222060 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.222197 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.222520 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.222741 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.222887 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.223127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.223264 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.223466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.223711 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.223873 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.224125 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.224277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.224482 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.224621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.224801 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.225110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.225247 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.225426 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.225742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.226112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.226273 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.226550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.226701 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.226835 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.226967 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.227096 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.227349 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.227570 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.227719 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.227937 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.228070 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.228219 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.228390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.228528 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.228798 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.228940 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.229135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.229336 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.229473 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.229758 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.229900 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.230073 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.230260 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.230449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.231224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.231433 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.231696 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.231843 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.232115 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.232257 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.232444 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.232631 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.232775 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.233075 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.233219 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.233392 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.233677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.233910 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.234056 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.234211 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.234410 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.234603 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.234741 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.234911 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.235203 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.235348 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.235619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.235758 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.235944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.236143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.236386 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.236586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.236789 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.236928 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.237210 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.237473 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.237655 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.237823 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.238083 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.238238 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.238510 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.238661 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.238807 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.239004 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.239140 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.239387 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.239552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.239753 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.239942 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.240080 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.240358 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.240492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.240675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.240872 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.241008 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.241291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.241435 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.241578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.241780 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.241933 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.242170 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.242314 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.242477 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.242701 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.242839 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.243080 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.243222 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.243407 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.243722 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.243877 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.244096 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.244272 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.244422 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.244621 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.244766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.244929 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.245234 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.245370 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.245542 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.245729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.245865 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.246173 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.246326 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.246559 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.246762 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.246976 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.247113 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.247246 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.247388 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.247642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.247788 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.247981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.248289 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.248610 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.248768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.248904 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.249225 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.249362 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.249559 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.249780 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.249923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.250148 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.250294 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.250481 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.250791 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.251148 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.251300 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.251552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.251705 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.252013 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.252168 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.252350 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.252543 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.252681 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.252979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.253126 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.253313 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.253609 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.253748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.253920 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.254137 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.254292 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.254542 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.254764 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.254899 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.255070 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.255207 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.255453 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.255685 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.255824 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.256099 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.256232 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.256413 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.256710 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.256857 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.257012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.257216 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.257361 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.257544 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.257708 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.257927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.258070 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.258205 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.258458 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.258613 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.258807 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.258957 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.259125 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.259387 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.259597 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.259815 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.259952 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.260136 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.260323 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.260469 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.260756 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.260906 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.261069 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.261254 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.261391 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.262209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.262408 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.262581 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.262750 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.262922 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.263137 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.263347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.263583 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.263793 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.263968 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.264268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.264460 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.264644 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.264937 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.265132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.265132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.265408 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.265542 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.265748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.265906 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.266077 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.266350 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.266487 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.266695 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.266969 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.267109 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.267256 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.267472 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.267694 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.267826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.267982 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.268215 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.268352 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.268607 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.268752 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.268900 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.269128 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.269266 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.269505 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.269647 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.269824 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.270047 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.270212 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.270424 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.270560 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.270730 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.270973 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.271127 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.271331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.271466 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.271749 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.271934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.272079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.272279 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.272422 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.272590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.272861 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.273003 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.273181 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.273350 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.273486 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.273777 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.273921 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.274082 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.274305 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.274519 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.274663 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.274930 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.275080 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.275258 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.275403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.275588 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.275882 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.276018 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.276187 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.276430 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.276580 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.276840 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.277114 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.277282 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.277966 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.278206 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.278440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.278592 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.278799 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.278939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.279072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.279244 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.279381 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.279610 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.279882 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.280018 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.280231 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.280373 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.280567 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.280801 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.280937 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.281180 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.281312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.281494 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.281707 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.281864 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.282104 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.282249 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.282415 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.282629 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.282767 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.283060 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.283203 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.283366 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.283556 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.283722 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.283992 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.284133 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.284347 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.284498 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.284708 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.284928 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.285155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.285298 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.285445 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.285652 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.285872 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.286018 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.286182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.286494 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.286636 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.286804 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.287034 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.287302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.287444 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.287670 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.287862 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.288078 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.288358 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.288651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.288850 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.289127 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.289325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.289508 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.289508 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.289839 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.290009 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.290009 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.290347 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.290577 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.290735 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.290969 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.291170 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.291358 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.291702 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.291884 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.292081 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.292333 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.292536 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.292536 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:47:15.292912 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.293089 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.293409 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.293802 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.294191 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.294579 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.294982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.295388 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.295842 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.296239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.296752 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.297174 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.297586 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.297988 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.298392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.298776 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.299169 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.299580 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.299968 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.300352 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.300754 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.301138 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.301542 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.301931 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.302353 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.302690 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.303075 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.303489 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.304387 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.304387 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.304669 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.305009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.305411 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.305795 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.306308 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.306715 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.307101 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.307533 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.307880 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.308304 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.308719 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.309125 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.309730 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.310134 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.310521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.310933 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.311340 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.311759 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.312169 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.312570 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.312951 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.313330 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.313718 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.314100 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.314492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.314853 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.315241 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.315649 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.316062 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.316396 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.316796 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.317189 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.317674 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.317976 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.318357 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.318741 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.319130 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.319586 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.319963 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.320369 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.320753 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.321149 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.321545 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.321949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.322340 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.323916 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.324081 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.325018 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.325422 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.325820 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.326222 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.326621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.327022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.327700 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.328111 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.328507 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.328923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.329315 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.329719 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.330111 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.330504 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.330894 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.331286 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.331700 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.332106 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.332510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.332917 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.333331 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.333743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.334137 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.334528 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.334921 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.335354 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.335770 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.336155 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.336550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.336942 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.337333 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.337724 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.338116 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.338519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.338931 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.339291 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.339709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.340644 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.341039 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.341440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.341853 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.343056 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.343056 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.343056 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.343497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.343977 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.344369 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.344786 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.345190 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.345590 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.346237 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.346633 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.347032 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.347412 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.347815 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.348208 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.348594 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.349049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.349388 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.349785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.350167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.350619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.350938 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.351737 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.352201 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.352594 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.352999 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.353405 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.353798 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.354182 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.354584 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.354980 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.355208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO dbcounter [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Registered counter for database nova_api Aug 24 17:47:15.355459 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.355869 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.356260 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.356642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.357022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.357411 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.357797 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.358289 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.358600 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.358981 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.359388 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.359874 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.360190 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.360640 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.360957 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.361338 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.361759 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.362138 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.362517 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.362904 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.363348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.363752 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.364143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.364529 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.364921 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.365306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.365687 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.366086 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.366469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.366899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.367295 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.367741 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.368105 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.368496 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.368884 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.369329 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.369711 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.370422 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.372663 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.373020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.373464 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.373777 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.374107 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.374432 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.374756 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.375104 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.375915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.375915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.376107 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.376393 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.376716 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.377040 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.377365 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.377690 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.377989 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_db.sqlalchemy.engines [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:47:15.378670 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.378670 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.378670 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.379346 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.379346 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.379825 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.380115 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.380320 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.380560 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.380895 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.381206 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.381531 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.381853 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.382214 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.382488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.382805 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.383130 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.383470 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.383833 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.384124 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.384564 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.384887 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.385107 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writer thread running {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:47:15.385266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.385529 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.385845 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.386174 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.386547 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.387395 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.387760 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.388083 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.388479 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.388829 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.389167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.389776 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.390100 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.390416 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.391777 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.391777 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.391777 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.391777 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.392570 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.392570 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.392570 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.393019 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.393173 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.393482 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.393792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.394108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.394417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.394727 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.395037 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.395347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.395726 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.396037 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.396354 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.396666 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.396969 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.397278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.397586 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.398882 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.398882 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.398882 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.398882 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.399526 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.399526 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.399851 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.400133 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.400465 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.400793 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.401118 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.401434 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.401772 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.402087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.402457 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.402775 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.403091 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.403407 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.404270 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.404604 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.404938 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.405248 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.405577 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.405899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.406223 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.406545 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.406863 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.407312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.407660 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.407977 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.408293 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.408608 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.409018 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.409239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.409584 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.409899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.410231 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.410552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.410880 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.411212 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.411583 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.411895 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.412270 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.412575 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.412971 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.413233 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.413571 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.414581 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.414581 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.414581 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 17:47:15.415058 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 17:47:15.442298 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.context [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39b63279-b6ad-4ef4-bccd-f728c091053f(cell1) {{(pid=126994) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:47:15.446350 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:15.446822 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:15.448436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:15.449739 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:15.450161 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:15.452410 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:15.454356 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO dbcounter [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Registered counter for database nova_cell0 Aug 24 17:47:15.458367 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO dbcounter [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Registered counter for database nova_cell1 Aug 24 17:47:15.468069 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_db.sqlalchemy.engines [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:47:15.468381 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_db.sqlalchemy.engines [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:47:15.475679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writer thread running {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:47:15.476990 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writer thread running {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:47:15.477247 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO dbcounter [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Registered counter for database nova_api Aug 24 17:47:15.497409 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_db.sqlalchemy.engines [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:47:15.503905 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writer thread running {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:47:15.560611 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.context [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39b63279-b6ad-4ef4-bccd-f728c091053f(cell1) {{(pid=126993) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 17:47:15.564699 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:15.565180 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:15.566775 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:15.567552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:47:15.568011 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:47:15.569985 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:47:15.571979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO dbcounter [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Registered counter for database nova_cell0 Aug 24 17:47:15.576530 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO dbcounter [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Registered counter for database nova_cell1 Aug 24 17:47:15.583751 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_db.sqlalchemy.engines [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:47:15.586332 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_db.sqlalchemy.engines [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:47:15.591101 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writer thread running {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:47:15.626680 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO dbcounter [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Registered counter for database nova_cell0 Aug 24 17:47:15.633166 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_db.sqlalchemy.engines [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:47:15.637602 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writer thread running {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:47:15.738028 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writer thread running {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:47:15.748352 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO dbcounter [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Registered counter for database nova_cell0 Aug 24 17:47:15.755093 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_db.sqlalchemy.engines [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 17:47:15.759471 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writer thread running {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 17:47:15.958167 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: WARNING keystonemiddleware.auth_token [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:47:15.966193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: WARNING keystonemiddleware.auth_token [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:47:16.082389 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: WARNING keystonemiddleware.auth_token [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:47:16.089697 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: WARNING keystonemiddleware.auth_token [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:47:16.310258 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: WARNING keystonemiddleware.auth_token [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:47:16.316752 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: WARNING keystonemiddleware.auth_token [None req-82696997-cc2f-45e4-a841-d41a98a05d90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:47:16.322321 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4be1029c0 pid: 126994 (default app) Aug 24 17:47:16.434839 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: WARNING keystonemiddleware.auth_token [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 17:47:16.440860 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: WARNING keystonemiddleware.auth_token [None req-e0d326c6-ae00-4b9c-95bf-afdd33614621 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 17:47:16.446197 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4be1029c0 pid: 126993 (default app) Aug 24 17:47:51.642545 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=3 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:51.644108 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=3 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:51.645018 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=3 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:51.645974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=3 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:52.958852 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3ca5880c-3f95-49ef-aa26-01dc9346240e tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] Action: 'create', calling method: .version_select at 0x7f4b2b8c08b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1555911215", "metadata": {"Type": "work"}}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:47:54.618934 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3ca5880c-3f95-49ef-aa26-01dc9346240e tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.983841 Aug 24 17:47:54.620167 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Aug 24 17:47:51 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2986 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 17:47:55.143099 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4f08eae9-8c0f-4e9a-99d2-1bf101e04b55 tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] Calling method '.version_select at 0x7f4b2b974430>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:55.189366 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=3 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:55.191274 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=3 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:55.193233 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=3 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:55.196922 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=3 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:47:56.450814 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4f08eae9-8c0f-4e9a-99d2-1bf101e04b55 tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e9eff329-50fd-4c69-aeb1-ace8f3036f28" status: 200 len: 354 microversion: 2.1 time: 1.783899 Aug 24 17:47:56.450814 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 1/2] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:47:54 2022] GET /compute/v2.1/os-volumes/e9eff329-50fd-4c69-aeb1-ace8f3036f28 => generated 354 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:56.453248 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d317b81f-8229-4b12-9bd2-9567467fef28 tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] Calling method '.version_select at 0x7f4b2b71b700>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:56.528787 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d317b81f-8229-4b12-9bd2-9567467fef28 tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e9eff329-50fd-4c69-aeb1-ace8f3036f28" status: 200 len: 354 microversion: 2.1 time: 0.102877 Aug 24 17:47:56.529522 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:47:56 2022] GET /compute/v2.1/os-volumes/e9eff329-50fd-4c69-aeb1-ace8f3036f28 => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:56.544822 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2bf659cb-f112-43c7-b1b3-ac46399bfb25 tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] Calling method '.version_select at 0x7f4b2b750790>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:56.712553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2bf659cb-f112-43c7-b1b3-ac46399bfb25 tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/e9eff329-50fd-4c69-aeb1-ace8f3036f28" status: 202 len: 0 microversion: 2.1 time: 0.173166 Aug 24 17:47:56.716085 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 17:47:56 2022] DELETE /compute/v2.1/os-volumes/e9eff329-50fd-4c69-aeb1-ace8f3036f28 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:47:56.724706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-58a1c966-8979-49ef-8418-fff3c731f6dd tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] Calling method '.version_select at 0x7f4b2b71bdc0>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:56.829889 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-58a1c966-8979-49ef-8418-fff3c731f6dd tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e9eff329-50fd-4c69-aeb1-ace8f3036f28" status: 200 len: 353 microversion: 2.1 time: 0.110227 Aug 24 17:47:56.836043 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:47:56 2022] GET /compute/v2.1/os-volumes/e9eff329-50fd-4c69-aeb1-ace8f3036f28 => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:47:57.848379 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0031114e-7aa0-423d-bb3f-ce513f7c2b20 tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] Calling method '.version_select at 0x7f4b2b750940>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:47:57.894784 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-0031114e-7aa0-423d-bb3f-ce513f7c2b20 tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] HTTP exception thrown: Volume e9eff329-50fd-4c69-aeb1-ace8f3036f28 could not be found. Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0031114e-7aa0-423d-bb3f-ce513f7c2b20 tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] Request method failure captured: Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/os-volumes/e9eff329-50fd-4c69-aeb1-ace8f3036f28 HTTP/1.1 Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmRHMO1NxK0LGIQ9YWkZpA_uN4VPNQcGD6wIX_2xZVd7O-cVRGf8mwSbhh-7DBfq-h5L50k-4E6unigPuiAzUT6tlGcSVaDAtiz-s0hKjLFGG-PcM-0UC9BQou0nHhAB2_PtMO85yWWZ-aedKixlwZVqeN30pLSoLANImb0OYWgdiLk Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: ea9de30b5aa5498c9786ff1fbd24f213 Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-VolumesGetTestJSON-1436371334 Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:47:57.900348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ea9de30b5aa5498c9786ff1fbd24f213"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ea9de30b5aa5498c9786ff1fbd24f213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ea9de30b5aa5498c9786ff1fbd24f213"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ea9de30b5aa5498c9786ff1fbd24f213"}]}] Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-VolumesGetTestJSON-1436371334 Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: ea9de30b5aa5498c9786ff1fbd24f213 Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-VolumesGetTestJSON-1436371334 Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-VolumesGetTestJSON-1436371334-project Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 8b302a4d67684a509ad3b57fa14c25f0 Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-VolumesGetTestJSON-1436371334-project Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Volume e9eff329-50fd-4c69-aeb1-ace8f3036f28 could not be found. Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': 'e9eff329-50fd-4c69-aeb1-ace8f3036f28'} Aug 24 17:47:57.901557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9eff329-50fd-4c69-aeb1-ace8f3036f28 could not be found. (HTTP 404) (Request-ID: req-7787822d-6820-4ee7-8615-14d54853f77d) Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:47:57.902255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:47:57.906935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9eff329-50fd-4c69-aeb1-ace8f3036f28 could not be found. Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:47:57.908392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9eff329-50fd-4c69-aeb1-ace8f3036f28 could not be found. Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9eff329-50fd-4c69-aeb1-ace8f3036f28 could not be found. Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0031114e-7aa0-423d-bb3f-ce513f7c2b20 tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] Returning 404 to user: Volume e9eff329-50fd-4c69-aeb1-ace8f3036f28 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0031114e-7aa0-423d-bb3f-ce513f7c2b20 tempest-VolumesGetTestJSON-1436371334 tempest-VolumesGetTestJSON-1436371334-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e9eff329-50fd-4c69-aeb1-ace8f3036f28" status: 404 len: 109 microversion: 2.1 time: 0.062412 Aug 24 17:47:57.911275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 3/6] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:47:57 2022] GET /compute/v2.1/os-volumes/e9eff329-50fd-4c69-aeb1-ace8f3036f28 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:48:05.934429 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9fa02fc0-d7d2-457c-bfee-15769c7f88c1 tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] Calling method '.version_select at 0x7f4b2c0ecca0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:06.012576 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-904277353", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "networks": [{"uuid": "9de81dac-b84b-4053-b909-7b5379a734d3"}]}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:06.065713 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9fa02fc0-d7d2-457c-bfee-15769c7f88c1 tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3b62424b-c4fe-494c-9708-3eb2b8a162f6" status: 200 len: 351 microversion: 2.1 time: 0.135932 Aug 24 17:48:06.066725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:48:05 2022] GET /compute/v2.1/os-volumes/3b62424b-c4fe-494c-9708-3eb2b8a162f6 => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:06.246085 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.network.neutron [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] validate_networks() for [('9de81dac-b84b-4053-b909-7b5379a734d3', None, None, None, None, None)] {{(pid=126994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:48:07.821084 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c78ed6e4-2804-4dfb-9a19-9b4cf0ee9c98 tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] Calling method '.version_select at 0x7f4b2b6fb040>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:07.916509 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c78ed6e4-2804-4dfb-9a19-9b4cf0ee9c98 tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/7389a83d-50bb-44ad-93a3-9fe6fd9b8dd4" status: 200 len: 350 microversion: 2.1 time: 0.099323 Aug 24 17:48:07.925955 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 5/8] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:48:07 2022] GET /compute/v2.1/os-volumes/7389a83d-50bb-44ad-93a3-9fe6fd9b8dd4 => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:08.994101 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2025032137", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:09.244875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] validate_networks() for [('42250e67-e026-4ee8-a8ab-86c733e9a211', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:48:09.497479 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Flavor limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:48:09.497991 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Image limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:48:09.498781 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Flavor pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:48:09.500187 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Image pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:48:09.501314 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:48:09.535570 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:09.538427 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:09.542716 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:09.543968 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:09.546238 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:09.547625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:09.652204 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Getting quotas for project 4bca50d38140438ebd32cdcb25c65e3d. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:48:09.672697 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Getting quotas for user add01791e1374db2993c4258ec6b6d6b and project 4bca50d38140438ebd32cdcb25c65e3d. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:48:09.700112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Going to run 1 instances... {{(pid=126994) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:48:09.706342 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:48:09.896756 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f9a69e2d-0a9e-470b-bd6d-6a12dfaa4962 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.673567 Aug 24 17:48:09.911073 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 4/9] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:48:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 4689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:48:10.669111 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8fede0df-cd8f-409a-9fbd-32f285eabddf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Action: 'create', calling method: .version_select at 0x7f4b2b636c10>, body: {"keypair": {"name": "tempest-keypair-1554621386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJC1R6VQt58Gd1Oc3STkZG6FTYh/DVjUOJUYRgbNRyi4anSs0/sYy3B1S61yQ6uYFkCiuDuw62wMjg2dp3+FsEFfwnOO9cPbaHRFw19pCJJxrkuvRQDFdDMcgHgGRu17A=="}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:10.721239 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-8fede0df-cd8f-409a-9fbd-32f285eabddf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Getting quotas for project 2fe3fa5e280d4fbd8a26cac05fe8aaa9. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:48:10.735512 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-8fede0df-cd8f-409a-9fbd-32f285eabddf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Getting quotas for user 7813dcd78a38483682842ac199e1cd18 and project 2fe3fa5e280d4fbd8a26cac05fe8aaa9. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:48:10.830682 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8fede0df-cd8f-409a-9fbd-32f285eabddf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.917731 Aug 24 17:48:10.831591 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 5/10] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Aug 24 17:48:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 920 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 17:48:10.840468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4b9a247b-961b-40dc-97a3-1c7917b0941c tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] Calling method '.version_select at 0x7f4b2a5e9550>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:11.429410 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4b9a247b-961b-40dc-97a3-1c7917b0941c tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ee6ae9fe-ca2e-4625-a526-aac03be30314" status: 200 len: 351 microversion: 2.1 time: 0.596199 Aug 24 17:48:11.430028 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 6/11] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:48:10 2022] GET /compute/v2.1/os-volumes/ee6ae9fe-ca2e-4625-a526-aac03be30314 => generated 351 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:11.448143 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ec49a557-10bd-41a6-81ad-a4ac1859f416 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:11.448790 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ec49a557-10bd-41a6-81ad-a4ac1859f416 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:11.817107 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ec49a557-10bd-41a6-81ad-a4ac1859f416 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:11.847571 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ec49a557-10bd-41a6-81ad-a4ac1859f416 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1214 microversion: 2.1 time: 0.407634 Aug 24 17:48:11.849624 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 7/12] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:11 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1214 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:11.858402 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-47f871a5-e73d-4c0d-9025-ba0e6c78bfab tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] Calling method '.version_select at 0x7f4b2a5ee5e0>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:12.266115 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:48:12.266574 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:48:12.267028 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:48:12.267528 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:48:12.267969 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:48:12.326073 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:12.327537 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:12.328189 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:12.335102 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:12.337341 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:12.338958 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:12.384095 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-47f871a5-e73d-4c0d-9025-ba0e6c78bfab tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.532964 Aug 24 17:48:12.395225 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 8/13] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Aug 24 17:48:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:12.400714 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-88b6afde-134f-4acb-bf23-ee584746bb8a tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] Calling method '.version_select at 0x7f4b29d90430>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:12.495112 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Getting quotas for project 0fb78a439e20439f8d93a4f7df3f28f8. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:48:12.523459 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Getting quotas for user 7d3139d9e58f4b56a370661e2a5d4e5e and project 0fb78a439e20439f8d93a4f7df3f28f8. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:48:12.547280 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:48:12.552490 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:48:12.808213 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ca8abb03-d7e8-4c98-b9b7-5c0ea3961966 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.495882 Aug 24 17:48:12.814510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 6/14] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:48:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 4503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:48:12.846642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2074d3fb-e8f8-4f90-8b1e-61cbb179c9c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:12.866104 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2074d3fb-e8f8-4f90-8b1e-61cbb179c9c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:12.912978 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-88b6afde-134f-4acb-bf23-ee584746bb8a tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.517744 Aug 24 17:48:12.914321 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 9/15] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Aug 24 17:48:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:12.930798 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-13b843f1-082b-48f6-8bc2-9dbe54307e8d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:12.932455 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-13b843f1-082b-48f6-8bc2-9dbe54307e8d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:12.955448 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-13b843f1-082b-48f6-8bc2-9dbe54307e8d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:12.973965 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-13b843f1-082b-48f6-8bc2-9dbe54307e8d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:12.974415 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-13b843f1-082b-48f6-8bc2-9dbe54307e8d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:12.975126 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-13b843f1-082b-48f6-8bc2-9dbe54307e8d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:12.986148 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-13b843f1-082b-48f6-8bc2-9dbe54307e8d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:12.986675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-13b843f1-082b-48f6-8bc2-9dbe54307e8d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:13.287923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-13b843f1-082b-48f6-8bc2-9dbe54307e8d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:13.333343 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-13b843f1-082b-48f6-8bc2-9dbe54307e8d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1210 microversion: 2.1 time: 0.405092 Aug 24 17:48:13.338838 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 10/16] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:12 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1210 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:13.365304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-adb6648c-7e29-4a03-a396-0ae61785a097 tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] Calling method '.version_select at 0x7f4b29d02d30>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:13.465393 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2074d3fb-e8f8-4f90-8b1e-61cbb179c9c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:13.495129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2074d3fb-e8f8-4f90-8b1e-61cbb179c9c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1222 microversion: 2.1 time: 0.676204 Aug 24 17:48:13.508267 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 7/17] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:12 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1222 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:13.596297 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-adb6648c-7e29-4a03-a396-0ae61785a097 tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.246045 Aug 24 17:48:13.596948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 11/18] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Aug 24 17:48:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:13.622143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6fb8bb5f-aeff-4c94-a289-7d1c778a7744 tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] Calling method '.version_select at 0x7f4b2adb80d0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:13.799769 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-775071251", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:13.819520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6fb8bb5f-aeff-4c94-a289-7d1c778a7744 tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.213453 Aug 24 17:48:13.820627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 8/19] 10.222.0.27 () {58 vars in 1167 bytes} [Wed Aug 24 17:48:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:13.834578 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0758d871-e5b0-4959-a935-c5dca83f901c tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] Calling method '.version_select at 0x7f4b2b750670>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:13.913647 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.network.neutron [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] validate_networks() for [('42250e67-e026-4ee8-a8ab-86c733e9a211', None, None, None, None, None)] {{(pid=126994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:48:14.254492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0758d871-e5b0-4959-a935-c5dca83f901c tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.423826 Aug 24 17:48:14.255545 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 9/20] 10.222.0.27 () {58 vars in 1170 bytes} [Wed Aug 24 17:48:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:48:14.268659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3ff8498b-7976-42f4-a67a-7f728a791524 tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] Calling method '.version_select at 0x7f4b2a54a0d0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:15.064421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-3ff8498b-7976-42f4-a67a-7f728a791524 tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.799426 Aug 24 17:48:15.065734 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 10/21] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Aug 24 17:48:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:15.070851 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b7630fde-e131-474d-9acc-11ce28b540fe tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:15.071807 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b7630fde-e131-474d-9acc-11ce28b540fe tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:15.101839 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b7630fde-e131-474d-9acc-11ce28b540fe tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:15.103963 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b7630fde-e131-474d-9acc-11ce28b540fe tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:15.106227 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b7630fde-e131-474d-9acc-11ce28b540fe tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:15.107155 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b7630fde-e131-474d-9acc-11ce28b540fe tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:15.110345 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b7630fde-e131-474d-9acc-11ce28b540fe tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:15.110801 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b7630fde-e131-474d-9acc-11ce28b540fe tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:15.639424 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b7630fde-e131-474d-9acc-11ce28b540fe tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:15.669933 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b7630fde-e131-474d-9acc-11ce28b540fe tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1272 microversion: 2.1 time: 0.602936 Aug 24 17:48:15.672489 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 11/22] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:15 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1272 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:15.708064 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-bacd6028-5694-477a-bb9c-4e94c6afa3ae tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] Calling method '.version_select at 0x7f4b2a4d81f0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:15.986377 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Flavor limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:48:15.987377 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Image limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:48:15.988037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Flavor pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:48:15.988613 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Image pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:48:15.989204 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:48:16.003361 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:16.004772 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:16.009036 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:16.010589 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:16.011261 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:16.012029 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:16.066016 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Getting quotas for project 0fb78a439e20439f8d93a4f7df3f28f8. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:48:16.083840 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Getting quotas for user 7d3139d9e58f4b56a370661e2a5d4e5e and project 0fb78a439e20439f8d93a4f7df3f28f8. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:48:16.104685 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Going to run 1 instances... {{(pid=126994) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:48:16.111614 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:48:16.160208 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-bacd6028-5694-477a-bb9c-4e94c6afa3ae tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.485710 Aug 24 17:48:16.161751 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 12/23] 10.222.0.27 () {58 vars in 1188 bytes} [Wed Aug 24 17:48:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:16.171394 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1986646180", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4887da7-fc9b-4bdc-bef8-72d9aff23bba"}], "security_groups": [{"name": "tempest-securitygroup--112157972"}], "key_name": "tempest-keypair-1554621386", "user_data": "}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:16.218136 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-2b63614e-fff9-4082-bc29-35c6c28626d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.425004 Aug 24 17:48:16.218136 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 12/24] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:48:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:48:16.239376 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-34acfb6f-6697-46b3-9420-7fa7cc3e1775 tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] Calling method '.version_select at 0x7f4b29d02c10>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:16.426596 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-34acfb6f-6697-46b3-9420-7fa7cc3e1775 tempest-VolumesTestJSON-702295363 tempest-VolumesTestJSON-702295363-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.207154 Aug 24 17:48:16.427167 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 13/25] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Aug 24 17:48:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:16.431916 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-df6fb114-e037-4e4a-b316-3f1009221d26 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:16.432418 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-df6fb114-e037-4e4a-b316-3f1009221d26 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:16.446589 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] validate_networks() for [('b4887da7-fc9b-4bdc-bef8-72d9aff23bba', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:48:16.938134 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-df6fb114-e037-4e4a-b316-3f1009221d26 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:16.945245 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-df6fb114-e037-4e4a-b316-3f1009221d26 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1221 microversion: 2.1 time: 0.517030 Aug 24 17:48:16.959844 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 14/26] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:16 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1221 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:16.973261 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9f0128f8-eda6-4950-9642-2af9b23f06e6 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:16.974749 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9f0128f8-eda6-4950-9642-2af9b23f06e6 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:16.992631 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9f0128f8-eda6-4950-9642-2af9b23f06e6 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:16.995375 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9f0128f8-eda6-4950-9642-2af9b23f06e6 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:16.997154 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9f0128f8-eda6-4950-9642-2af9b23f06e6 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:17.000587 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9f0128f8-eda6-4950-9642-2af9b23f06e6 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:17.001261 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9f0128f8-eda6-4950-9642-2af9b23f06e6 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:17.001969 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9f0128f8-eda6-4950-9642-2af9b23f06e6 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:17.060954 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:48:17.061648 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:48:17.062427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:48:17.062942 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:48:17.063601 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:48:17.089150 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:17.090026 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:17.091988 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:17.093884 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:17.095740 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:17.096478 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:17.128776 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Getting quotas for project 2fe3fa5e280d4fbd8a26cac05fe8aaa9. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:48:17.134183 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Getting quotas for user 7813dcd78a38483682842ac199e1cd18 and project 2fe3fa5e280d4fbd8a26cac05fe8aaa9. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:48:17.148312 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9f0128f8-eda6-4950-9642-2af9b23f06e6 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:17.162156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:48:17.164337 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:48:17.167600 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9f0128f8-eda6-4950-9642-2af9b23f06e6 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1272 microversion: 2.1 time: 0.204644 Aug 24 17:48:17.179505 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 15/27] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:16 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:17.265614 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8a75c81b-137d-44db-af7e-d8b99af732b6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.102286 Aug 24 17:48:17.267515 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 13/28] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Aug 24 17:48:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 17:48:17.279941 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-40c3f0f7-f366-44e8-8a4e-b84980543bd0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:17.280824 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-40c3f0f7-f366-44e8-8a4e-b84980543bd0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:17.379782 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-40c3f0f7-f366-44e8-8a4e-b84980543bd0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:17.392062 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-40c3f0f7-f366-44e8-8a4e-b84980543bd0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:17.394365 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-40c3f0f7-f366-44e8-8a4e-b84980543bd0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:17.396076 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-40c3f0f7-f366-44e8-8a4e-b84980543bd0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1282 microversion: 2.20 time: 0.120962 Aug 24 17:48:17.397275 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 16/29] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:17 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:48:17.967667 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-18ded6c5-c1fa-4162-873a-634114a69714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:17.968394 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-18ded6c5-c1fa-4162-873a-634114a69714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:17.978540 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-18ded6c5-c1fa-4162-873a-634114a69714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:17.979032 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-18ded6c5-c1fa-4162-873a-634114a69714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:17.979491 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-18ded6c5-c1fa-4162-873a-634114a69714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:17.980211 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-18ded6c5-c1fa-4162-873a-634114a69714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:17.980656 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-18ded6c5-c1fa-4162-873a-634114a69714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:17.981081 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-18ded6c5-c1fa-4162-873a-634114a69714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:18.074093 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-18ded6c5-c1fa-4162-873a-634114a69714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:18.091131 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-18ded6c5-c1fa-4162-873a-634114a69714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1225 microversion: 2.1 time: 0.128019 Aug 24 17:48:18.092156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 14/30] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:17 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:18.191913 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1d6c7582-266d-478c-a1bc-00d3e2aea0b9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:18.192579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1d6c7582-266d-478c-a1bc-00d3e2aea0b9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:18.200008 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1d6c7582-266d-478c-a1bc-00d3e2aea0b9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:18.200722 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1d6c7582-266d-478c-a1bc-00d3e2aea0b9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:18.201312 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1d6c7582-266d-478c-a1bc-00d3e2aea0b9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:18.202173 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1d6c7582-266d-478c-a1bc-00d3e2aea0b9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:18.202630 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1d6c7582-266d-478c-a1bc-00d3e2aea0b9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:18.203208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1d6c7582-266d-478c-a1bc-00d3e2aea0b9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:18.430623 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1c980de3-b5b8-408f-8f94-c820357ba20a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:18.431991 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1c980de3-b5b8-408f-8f94-c820357ba20a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:18.448047 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1c980de3-b5b8-408f-8f94-c820357ba20a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:18.449221 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1c980de3-b5b8-408f-8f94-c820357ba20a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:18.449891 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1c980de3-b5b8-408f-8f94-c820357ba20a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:18.451087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1c980de3-b5b8-408f-8f94-c820357ba20a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:18.452139 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1c980de3-b5b8-408f-8f94-c820357ba20a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:18.453559 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1c980de3-b5b8-408f-8f94-c820357ba20a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:18.533663 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1d6c7582-266d-478c-a1bc-00d3e2aea0b9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:18.549910 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1d6c7582-266d-478c-a1bc-00d3e2aea0b9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.356331 Aug 24 17:48:18.552212 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 17/31] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:18 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:18.597673 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1c980de3-b5b8-408f-8f94-c820357ba20a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:18.611106 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1c980de3-b5b8-408f-8f94-c820357ba20a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:18.613059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1c980de3-b5b8-408f-8f94-c820357ba20a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:18.614887 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1c980de3-b5b8-408f-8f94-c820357ba20a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1286 microversion: 2.20 time: 0.189685 Aug 24 17:48:18.615725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 15/32] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:18 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1286 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:19.118373 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-175aa413-637b-4642-af68-07d9cc44dabd tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:19.119516 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-175aa413-637b-4642-af68-07d9cc44dabd tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:19.135379 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-175aa413-637b-4642-af68-07d9cc44dabd tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:19.136436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-175aa413-637b-4642-af68-07d9cc44dabd tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:19.137326 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-175aa413-637b-4642-af68-07d9cc44dabd tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:19.140821 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-175aa413-637b-4642-af68-07d9cc44dabd tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:19.142821 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-175aa413-637b-4642-af68-07d9cc44dabd tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:19.143632 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-175aa413-637b-4642-af68-07d9cc44dabd tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:19.305685 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-175aa413-637b-4642-af68-07d9cc44dabd tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:19.320117 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-175aa413-637b-4642-af68-07d9cc44dabd tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1225 microversion: 2.1 time: 0.208268 Aug 24 17:48:19.337327 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 18/33] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:19 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1225 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:19.583720 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f567ee23-b35e-4c3e-81e7-6de8adbcc769 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:19.585117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f567ee23-b35e-4c3e-81e7-6de8adbcc769 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:19.599782 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f567ee23-b35e-4c3e-81e7-6de8adbcc769 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:19.605054 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f567ee23-b35e-4c3e-81e7-6de8adbcc769 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:19.606095 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f567ee23-b35e-4c3e-81e7-6de8adbcc769 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:19.607377 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f567ee23-b35e-4c3e-81e7-6de8adbcc769 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:19.623742 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f567ee23-b35e-4c3e-81e7-6de8adbcc769 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:19.624496 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f567ee23-b35e-4c3e-81e7-6de8adbcc769 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:19.641390 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-09c99180-3d31-42cf-a545-5f5723641135 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:19.643020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-09c99180-3d31-42cf-a545-5f5723641135 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:19.655327 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-09c99180-3d31-42cf-a545-5f5723641135 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:19.658961 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-09c99180-3d31-42cf-a545-5f5723641135 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:19.659720 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-09c99180-3d31-42cf-a545-5f5723641135 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:19.661301 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-09c99180-3d31-42cf-a545-5f5723641135 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:19.663279 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-09c99180-3d31-42cf-a545-5f5723641135 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:19.664447 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-09c99180-3d31-42cf-a545-5f5723641135 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:19.812569 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-09c99180-3d31-42cf-a545-5f5723641135 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:19.832124 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-09c99180-3d31-42cf-a545-5f5723641135 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:19.835236 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-09c99180-3d31-42cf-a545-5f5723641135 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:19.840430 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-09c99180-3d31-42cf-a545-5f5723641135 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1286 microversion: 2.20 time: 0.203866 Aug 24 17:48:19.844721 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 19/34] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:19 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1286 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:19.948721 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f567ee23-b35e-4c3e-81e7-6de8adbcc769 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:19.960899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-f567ee23-b35e-4c3e-81e7-6de8adbcc769 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.381095 Aug 24 17:48:19.961718 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 16/35] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:19 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:20.345353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e1b71747-c96c-49a3-9012-d6e04d8de7ed tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:20.346527 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e1b71747-c96c-49a3-9012-d6e04d8de7ed tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:20.359924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1b71747-c96c-49a3-9012-d6e04d8de7ed tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:20.363598 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1b71747-c96c-49a3-9012-d6e04d8de7ed tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:20.365831 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1b71747-c96c-49a3-9012-d6e04d8de7ed tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:20.367732 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1b71747-c96c-49a3-9012-d6e04d8de7ed tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:20.369043 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1b71747-c96c-49a3-9012-d6e04d8de7ed tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:20.370249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1b71747-c96c-49a3-9012-d6e04d8de7ed tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:20.871632 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b1a45d05-35b4-4308-a245-3fdfe2cb27a0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:20.874736 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b1a45d05-35b4-4308-a245-3fdfe2cb27a0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:20.882518 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e1b71747-c96c-49a3-9012-d6e04d8de7ed tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:20.895028 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b1a45d05-35b4-4308-a245-3fdfe2cb27a0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:20.896004 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b1a45d05-35b4-4308-a245-3fdfe2cb27a0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:20.897492 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e1b71747-c96c-49a3-9012-d6e04d8de7ed tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1217 microversion: 2.1 time: 0.556439 Aug 24 17:48:20.901987 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 20/36] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:20 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1217 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:20.903323 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b1a45d05-35b4-4308-a245-3fdfe2cb27a0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:20.904813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b1a45d05-35b4-4308-a245-3fdfe2cb27a0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:20.908565 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b1a45d05-35b4-4308-a245-3fdfe2cb27a0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:20.909284 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b1a45d05-35b4-4308-a245-3fdfe2cb27a0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:20.982660 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a269abef-a032-4a74-b1d3-d441351ff45a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:20.983282 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a269abef-a032-4a74-b1d3-d441351ff45a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:20.996816 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a269abef-a032-4a74-b1d3-d441351ff45a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:20.998921 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a269abef-a032-4a74-b1d3-d441351ff45a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:21.001583 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a269abef-a032-4a74-b1d3-d441351ff45a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:21.012197 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a269abef-a032-4a74-b1d3-d441351ff45a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:21.014556 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a269abef-a032-4a74-b1d3-d441351ff45a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:21.016003 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a269abef-a032-4a74-b1d3-d441351ff45a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:21.019158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b1a45d05-35b4-4308-a245-3fdfe2cb27a0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:21.030684 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b1a45d05-35b4-4308-a245-3fdfe2cb27a0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:21.044037 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b1a45d05-35b4-4308-a245-3fdfe2cb27a0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:21.047725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b1a45d05-35b4-4308-a245-3fdfe2cb27a0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1334 microversion: 2.20 time: 0.181201 Aug 24 17:48:21.050925 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 17/37] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:20 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1334 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:21.929390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-50fdf1d4-85a9-4952-96c7-f9595b833bfc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:21.932046 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-50fdf1d4-85a9-4952-96c7-f9595b833bfc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:21.957980 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-50fdf1d4-85a9-4952-96c7-f9595b833bfc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:21.959465 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-50fdf1d4-85a9-4952-96c7-f9595b833bfc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:21.962930 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-50fdf1d4-85a9-4952-96c7-f9595b833bfc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:21.967025 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-50fdf1d4-85a9-4952-96c7-f9595b833bfc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:21.967938 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-50fdf1d4-85a9-4952-96c7-f9595b833bfc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:21.972566 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-50fdf1d4-85a9-4952-96c7-f9595b833bfc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:22.070700 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a269abef-a032-4a74-b1d3-d441351ff45a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:22.096628 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a269abef-a032-4a74-b1d3-d441351ff45a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 1.117831 Aug 24 17:48:22.100865 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 21/38] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:20 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:22.121475 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-50fdf1d4-85a9-4952-96c7-f9595b833bfc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:22.123463 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1f8fdbcf-d2fb-4f2f-b8e8-a0425e4eb6c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:22.125827 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1f8fdbcf-d2fb-4f2f-b8e8-a0425e4eb6c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:22.152019 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-50fdf1d4-85a9-4952-96c7-f9595b833bfc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1273 microversion: 2.1 time: 0.226448 Aug 24 17:48:22.154361 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 18/39] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:21 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:22.174869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f8fdbcf-d2fb-4f2f-b8e8-a0425e4eb6c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:22.176271 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f8fdbcf-d2fb-4f2f-b8e8-a0425e4eb6c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:22.176953 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f8fdbcf-d2fb-4f2f-b8e8-a0425e4eb6c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:22.178240 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f8fdbcf-d2fb-4f2f-b8e8-a0425e4eb6c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:22.181149 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f8fdbcf-d2fb-4f2f-b8e8-a0425e4eb6c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:22.181619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f8fdbcf-d2fb-4f2f-b8e8-a0425e4eb6c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:22.542777 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1f8fdbcf-d2fb-4f2f-b8e8-a0425e4eb6c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:22.561856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1f8fdbcf-d2fb-4f2f-b8e8-a0425e4eb6c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:22.563495 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1f8fdbcf-d2fb-4f2f-b8e8-a0425e4eb6c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:22.564668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1f8fdbcf-d2fb-4f2f-b8e8-a0425e4eb6c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1334 microversion: 2.20 time: 0.460267 Aug 24 17:48:22.566368 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 22/40] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:22 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1334 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:23.125080 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3ce678bc-99d8-4a80-84f5-1954c6d59b14 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:23.126506 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3ce678bc-99d8-4a80-84f5-1954c6d59b14 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:23.133735 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ce678bc-99d8-4a80-84f5-1954c6d59b14 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:23.137804 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ce678bc-99d8-4a80-84f5-1954c6d59b14 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:23.138512 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ce678bc-99d8-4a80-84f5-1954c6d59b14 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:23.140015 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ce678bc-99d8-4a80-84f5-1954c6d59b14 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:23.141486 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ce678bc-99d8-4a80-84f5-1954c6d59b14 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:23.142169 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ce678bc-99d8-4a80-84f5-1954c6d59b14 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:23.174531 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fa44de0c-589e-4e46-9aec-f78c9b9514d3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:23.181908 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-fa44de0c-589e-4e46-9aec-f78c9b9514d3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:23.197513 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fa44de0c-589e-4e46-9aec-f78c9b9514d3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:23.198314 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fa44de0c-589e-4e46-9aec-f78c9b9514d3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:23.198920 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fa44de0c-589e-4e46-9aec-f78c9b9514d3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:23.199804 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fa44de0c-589e-4e46-9aec-f78c9b9514d3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:23.200396 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fa44de0c-589e-4e46-9aec-f78c9b9514d3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:23.201942 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fa44de0c-589e-4e46-9aec-f78c9b9514d3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:23.404128 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fa44de0c-589e-4e46-9aec-f78c9b9514d3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:23.415980 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-fa44de0c-589e-4e46-9aec-f78c9b9514d3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1279 microversion: 2.1 time: 0.244385 Aug 24 17:48:23.437114 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 23/41] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:23 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1279 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:23.469633 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-3ce678bc-99d8-4a80-84f5-1954c6d59b14 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:23.482279 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-3ce678bc-99d8-4a80-84f5-1954c6d59b14 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.361030 Aug 24 17:48:23.485057 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 19/42] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:23 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:23.612811 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-83a21ad8-71f6-4aa9-b427-9a65cca6ef08 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:23.614076 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-83a21ad8-71f6-4aa9-b427-9a65cca6ef08 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:23.638649 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-83a21ad8-71f6-4aa9-b427-9a65cca6ef08 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:23.644969 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-83a21ad8-71f6-4aa9-b427-9a65cca6ef08 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:23.646112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-83a21ad8-71f6-4aa9-b427-9a65cca6ef08 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:23.654963 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-83a21ad8-71f6-4aa9-b427-9a65cca6ef08 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:23.658834 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-83a21ad8-71f6-4aa9-b427-9a65cca6ef08 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:23.660047 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-83a21ad8-71f6-4aa9-b427-9a65cca6ef08 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:23.994318 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-83a21ad8-71f6-4aa9-b427-9a65cca6ef08 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:24.006888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-83a21ad8-71f6-4aa9-b427-9a65cca6ef08 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:24.014834 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-83a21ad8-71f6-4aa9-b427-9a65cca6ef08 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:24.020225 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-83a21ad8-71f6-4aa9-b427-9a65cca6ef08 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1340 microversion: 2.20 time: 0.425310 Aug 24 17:48:24.021570 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 24/43] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:23 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1340 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:48:24.445093 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d814e9e7-3524-4925-8d06-e025b90c4b51 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:24.446020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d814e9e7-3524-4925-8d06-e025b90c4b51 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:24.460024 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d814e9e7-3524-4925-8d06-e025b90c4b51 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:24.460593 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d814e9e7-3524-4925-8d06-e025b90c4b51 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:24.461404 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d814e9e7-3524-4925-8d06-e025b90c4b51 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:24.462339 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d814e9e7-3524-4925-8d06-e025b90c4b51 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:24.466355 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d814e9e7-3524-4925-8d06-e025b90c4b51 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:24.467095 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d814e9e7-3524-4925-8d06-e025b90c4b51 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:24.511323 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7e32adb4-7a7c-413a-a63b-7174a0e5443d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:24.512505 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7e32adb4-7a7c-413a-a63b-7174a0e5443d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:24.522428 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e32adb4-7a7c-413a-a63b-7174a0e5443d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:24.524193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e32adb4-7a7c-413a-a63b-7174a0e5443d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:24.527244 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e32adb4-7a7c-413a-a63b-7174a0e5443d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:24.528890 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e32adb4-7a7c-413a-a63b-7174a0e5443d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:24.531059 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e32adb4-7a7c-413a-a63b-7174a0e5443d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:24.532147 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e32adb4-7a7c-413a-a63b-7174a0e5443d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:24.791427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d814e9e7-3524-4925-8d06-e025b90c4b51 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:24.799514 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d814e9e7-3524-4925-8d06-e025b90c4b51 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1279 microversion: 2.1 time: 0.358298 Aug 24 17:48:24.801159 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 20/44] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:24 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1279 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:25.057917 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-eaeab20a-229a-4a6f-af07-5f15b5bf6302 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:25.059618 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-eaeab20a-229a-4a6f-af07-5f15b5bf6302 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:25.073757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eaeab20a-229a-4a6f-af07-5f15b5bf6302 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:25.075103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eaeab20a-229a-4a6f-af07-5f15b5bf6302 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:25.076176 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eaeab20a-229a-4a6f-af07-5f15b5bf6302 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:25.077366 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eaeab20a-229a-4a6f-af07-5f15b5bf6302 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:25.078079 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eaeab20a-229a-4a6f-af07-5f15b5bf6302 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:25.078799 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eaeab20a-229a-4a6f-af07-5f15b5bf6302 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:25.369976 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-eaeab20a-229a-4a6f-af07-5f15b5bf6302 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:25.391096 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-eaeab20a-229a-4a6f-af07-5f15b5bf6302 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:25.395174 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-eaeab20a-229a-4a6f-af07-5f15b5bf6302 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:25.399022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-eaeab20a-229a-4a6f-af07-5f15b5bf6302 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1340 microversion: 2.20 time: 0.351869 Aug 24 17:48:25.402099 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 21/45] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:25 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1340 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:25.425412 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7e32adb4-7a7c-413a-a63b-7174a0e5443d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:25.444546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7e32adb4-7a7c-413a-a63b-7174a0e5443d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.938283 Aug 24 17:48:25.448591 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 25/46] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:24 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:25.825494 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7ce36e88-d430-4453-be33-b08a75621c19 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:25.826366 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7ce36e88-d430-4453-be33-b08a75621c19 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:25.834239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ce36e88-d430-4453-be33-b08a75621c19 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:25.834887 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ce36e88-d430-4453-be33-b08a75621c19 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:25.835649 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ce36e88-d430-4453-be33-b08a75621c19 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:25.837111 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ce36e88-d430-4453-be33-b08a75621c19 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:25.837894 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ce36e88-d430-4453-be33-b08a75621c19 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:25.839408 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ce36e88-d430-4453-be33-b08a75621c19 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:26.426557 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-84087599-12e3-4329-93fd-ff4988093029 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:26.429206 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-84087599-12e3-4329-93fd-ff4988093029 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:26.440611 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=4 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:26.446845 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-84087599-12e3-4329-93fd-ff4988093029 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:26.459883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-84087599-12e3-4329-93fd-ff4988093029 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:26.461511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-84087599-12e3-4329-93fd-ff4988093029 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:26.467240 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-84087599-12e3-4329-93fd-ff4988093029 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:26.468936 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-84087599-12e3-4329-93fd-ff4988093029 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:26.470621 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-84087599-12e3-4329-93fd-ff4988093029 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:26.600761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7ce36e88-d430-4453-be33-b08a75621c19 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:26.613552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7ce36e88-d430-4453-be33-b08a75621c19 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.794435 Aug 24 17:48:26.628625 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 22/47] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:25 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:26.637571 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-045d2152-3f16-425c-8653-68c360861d6f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:26.638199 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-045d2152-3f16-425c-8653-68c360861d6f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:26.658977 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-045d2152-3f16-425c-8653-68c360861d6f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:26.659502 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-045d2152-3f16-425c-8653-68c360861d6f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:26.659954 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-045d2152-3f16-425c-8653-68c360861d6f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:26.660671 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-045d2152-3f16-425c-8653-68c360861d6f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:26.661145 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-045d2152-3f16-425c-8653-68c360861d6f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:26.661582 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-045d2152-3f16-425c-8653-68c360861d6f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:27.014016 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-84087599-12e3-4329-93fd-ff4988093029 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:27.030897 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-84087599-12e3-4329-93fd-ff4988093029 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:27.032462 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-84087599-12e3-4329-93fd-ff4988093029 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:27.033622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-84087599-12e3-4329-93fd-ff4988093029 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.613559 Aug 24 17:48:27.046256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 26/48] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:26 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:27.108903 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=4 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:27.155809 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=14 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:27.386942 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=22 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:27.720431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-7f00ef30-47a3-4f30-9949-f57679bdd470 req-c9bcfec3-6c39-4bfc-9bec-677782ec43b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca739a9-de86-4fb2-b047-7bc75fa540bb", "tag": "8a5ff39c-8fa9-4c77-85a2-b39dce880069"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:27.772505 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7f00ef30-47a3-4f30-9949-f57679bdd470 req-c9bcfec3-6c39-4bfc-9bec-677782ec43b5 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:27.779153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7f00ef30-47a3-4f30-9949-f57679bdd470 req-c9bcfec3-6c39-4bfc-9bec-677782ec43b5 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:27.781918 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7f00ef30-47a3-4f30-9949-f57679bdd470 req-c9bcfec3-6c39-4bfc-9bec-677782ec43b5 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:27.834741 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-045d2152-3f16-425c-8653-68c360861d6f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:27.855867 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-045d2152-3f16-425c-8653-68c360861d6f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 1.224477 Aug 24 17:48:27.859700 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 23/49] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:26 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:27.865725 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-7f00ef30-47a3-4f30-9949-f57679bdd470 req-c9bcfec3-6c39-4bfc-9bec-677782ec43b5 service nova] Creating event network-changed:8a5ff39c-8fa9-4c77-85a2-b39dce880069 for instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb on hv-cinder-84052 Aug 24 17:48:27.866256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7f00ef30-47a3-4f30-9949-f57679bdd470 req-c9bcfec3-6c39-4bfc-9bec-677782ec43b5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 17:48:27.866644 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7f00ef30-47a3-4f30-9949-f57679bdd470 req-c9bcfec3-6c39-4bfc-9bec-677782ec43b5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 17:48:27.867716 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3876257f-df94-4e3e-858b-a855f0039d17 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:27.884139 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3876257f-df94-4e3e-858b-a855f0039d17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:27.884603 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3876257f-df94-4e3e-858b-a855f0039d17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:27.885788 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3876257f-df94-4e3e-858b-a855f0039d17 None None] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:27.886941 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3876257f-df94-4e3e-858b-a855f0039d17 None None] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:27.887743 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3876257f-df94-4e3e-858b-a855f0039d17 None None] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:27.893636 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ad37035d-e8da-4efa-ac3b-3fc3ee6258ec tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:27.895741 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ad37035d-e8da-4efa-ac3b-3fc3ee6258ec tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:27.898675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.compute.rpcapi [None req-3876257f-df94-4e3e-858b-a855f0039d17 None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 17:48:27.900353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3876257f-df94-4e3e-858b-a855f0039d17 None None] Releasing lock "compute-rpcapi-router" {{(pid=126994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 17:48:27.915122 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ad37035d-e8da-4efa-ac3b-3fc3ee6258ec tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:27.922704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ad37035d-e8da-4efa-ac3b-3fc3ee6258ec tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:27.923602 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ad37035d-e8da-4efa-ac3b-3fc3ee6258ec tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:27.927291 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ad37035d-e8da-4efa-ac3b-3fc3ee6258ec tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:27.928017 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ad37035d-e8da-4efa-ac3b-3fc3ee6258ec tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:27.928707 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ad37035d-e8da-4efa-ac3b-3fc3ee6258ec tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:27.934546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3876257f-df94-4e3e-858b-a855f0039d17 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.883308 Aug 24 17:48:27.934546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 27/50] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:28.078625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-761a6f62-fdc2-41df-b639-4eb0b1221845 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:28.078625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-761a6f62-fdc2-41df-b639-4eb0b1221845 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:28.102232 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-761a6f62-fdc2-41df-b639-4eb0b1221845 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:28.103154 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-761a6f62-fdc2-41df-b639-4eb0b1221845 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:28.105117 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-761a6f62-fdc2-41df-b639-4eb0b1221845 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:28.106479 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-761a6f62-fdc2-41df-b639-4eb0b1221845 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:28.108783 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-761a6f62-fdc2-41df-b639-4eb0b1221845 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:28.109460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-761a6f62-fdc2-41df-b639-4eb0b1221845 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:28.556818 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-761a6f62-fdc2-41df-b639-4eb0b1221845 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:28.566201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-761a6f62-fdc2-41df-b639-4eb0b1221845 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:28.576053 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-761a6f62-fdc2-41df-b639-4eb0b1221845 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:28.579830 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-761a6f62-fdc2-41df-b639-4eb0b1221845 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.521028 Aug 24 17:48:28.580811 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 28/51] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:28 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:28.646398 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ad37035d-e8da-4efa-ac3b-3fc3ee6258ec tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:28.657276 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ad37035d-e8da-4efa-ac3b-3fc3ee6258ec tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.795045 Aug 24 17:48:28.661906 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 24/52] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:27 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:28.878054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c6c34868-146e-489a-9e31-b34091530fcb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:28.879413 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c6c34868-146e-489a-9e31-b34091530fcb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:28.886487 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c6c34868-146e-489a-9e31-b34091530fcb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:28.887229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c6c34868-146e-489a-9e31-b34091530fcb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:28.887842 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c6c34868-146e-489a-9e31-b34091530fcb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:28.888714 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c6c34868-146e-489a-9e31-b34091530fcb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:28.889304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c6c34868-146e-489a-9e31-b34091530fcb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:28.889868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c6c34868-146e-489a-9e31-b34091530fcb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:29.063216 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c6c34868-146e-489a-9e31-b34091530fcb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:29.073433 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c6c34868-146e-489a-9e31-b34091530fcb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.199178 Aug 24 17:48:29.082909 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 29/53] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:28 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:29.509182 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-208c68ea-b376-45c2-9c13-94174c368a32 req-98a00a60-dc87-4c30-8c96-982829eb83f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa644603-71e5-4474-ac86-f0f7ce938d0f", "tag": "739a8b43-ab7a-4d3c-b2a6-c214a877b1e1"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:29.544408 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-208c68ea-b376-45c2-9c13-94174c368a32 req-98a00a60-dc87-4c30-8c96-982829eb83f5 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:29.544900 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-208c68ea-b376-45c2-9c13-94174c368a32 req-98a00a60-dc87-4c30-8c96-982829eb83f5 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:29.545330 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-208c68ea-b376-45c2-9c13-94174c368a32 req-98a00a60-dc87-4c30-8c96-982829eb83f5 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:29.578148 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-208c68ea-b376-45c2-9c13-94174c368a32 req-98a00a60-dc87-4c30-8c96-982829eb83f5 service nova] Creating event network-changed:739a8b43-ab7a-4d3c-b2a6-c214a877b1e1 for instance aa644603-71e5-4474-ac86-f0f7ce938d0f on hv-cinder-84052 Aug 24 17:48:29.579005 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-208c68ea-b376-45c2-9c13-94174c368a32 req-98a00a60-dc87-4c30-8c96-982829eb83f5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 17:48:29.580437 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-208c68ea-b376-45c2-9c13-94174c368a32 req-98a00a60-dc87-4c30-8c96-982829eb83f5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 17:48:29.582110 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-048ae36a-dc90-427d-a0e1-7d700fbeb87a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:29.582949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-048ae36a-dc90-427d-a0e1-7d700fbeb87a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:29.583637 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-048ae36a-dc90-427d-a0e1-7d700fbeb87a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:29.584444 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-048ae36a-dc90-427d-a0e1-7d700fbeb87a None None] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:29.588473 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-048ae36a-dc90-427d-a0e1-7d700fbeb87a None None] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:29.589191 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-048ae36a-dc90-427d-a0e1-7d700fbeb87a None None] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:29.603909 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4a0b7faf-692e-42ac-aa00-9af319a0382c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:29.604823 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4a0b7faf-692e-42ac-aa00-9af319a0382c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:29.614999 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4a0b7faf-692e-42ac-aa00-9af319a0382c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:29.616679 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.compute.rpcapi [None req-048ae36a-dc90-427d-a0e1-7d700fbeb87a None None] Automatically selected compute RPC version 6.0 from minimum service version 62 Aug 24 17:48:29.617333 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4a0b7faf-692e-42ac-aa00-9af319a0382c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:29.617918 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4a0b7faf-692e-42ac-aa00-9af319a0382c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:29.620054 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-048ae36a-dc90-427d-a0e1-7d700fbeb87a None None] Releasing lock "compute-rpcapi-router" {{(pid=126993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 17:48:29.620784 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4a0b7faf-692e-42ac-aa00-9af319a0382c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:29.621388 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4a0b7faf-692e-42ac-aa00-9af319a0382c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:29.623998 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4a0b7faf-692e-42ac-aa00-9af319a0382c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:29.652105 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-048ae36a-dc90-427d-a0e1-7d700fbeb87a None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247046 Aug 24 17:48:29.653246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 25/54] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:29.684123 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f194b4a6-78b0-49de-b681-aef76e6b59fe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:29.685794 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f194b4a6-78b0-49de-b681-aef76e6b59fe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:29.698502 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f194b4a6-78b0-49de-b681-aef76e6b59fe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:29.699006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f194b4a6-78b0-49de-b681-aef76e6b59fe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:29.699707 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f194b4a6-78b0-49de-b681-aef76e6b59fe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:29.700704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f194b4a6-78b0-49de-b681-aef76e6b59fe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:29.701333 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f194b4a6-78b0-49de-b681-aef76e6b59fe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:29.701922 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f194b4a6-78b0-49de-b681-aef76e6b59fe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:29.904557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f194b4a6-78b0-49de-b681-aef76e6b59fe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:29.922311 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-f194b4a6-78b0-49de-b681-aef76e6b59fe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.237559 Aug 24 17:48:29.923298 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 26/55] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:29 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:29.962293 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-0dc9b049-2e4a-4a1f-80b8-a698f452948f req-05633dff-fd1d-4063-9f1f-c8d9c3242f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0397fbeb-25d8-46af-98bb-8a7b70c97f48", "tag": "87b079d0-f5b8-4315-b27a-8988f8c98b86"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:29.979365 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-0dc9b049-2e4a-4a1f-80b8-a698f452948f req-05633dff-fd1d-4063-9f1f-c8d9c3242f5d service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:29.980572 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-0dc9b049-2e4a-4a1f-80b8-a698f452948f req-05633dff-fd1d-4063-9f1f-c8d9c3242f5d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:29.981884 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-0dc9b049-2e4a-4a1f-80b8-a698f452948f req-05633dff-fd1d-4063-9f1f-c8d9c3242f5d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:30.001949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-0dc9b049-2e4a-4a1f-80b8-a698f452948f req-05633dff-fd1d-4063-9f1f-c8d9c3242f5d service nova] Creating event network-changed:87b079d0-f5b8-4315-b27a-8988f8c98b86 for instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 on hv-cinder-84052 Aug 24 17:48:30.010338 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-0dc9b049-2e4a-4a1f-80b8-a698f452948f req-05633dff-fd1d-4063-9f1f-c8d9c3242f5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053429 Aug 24 17:48:30.012384 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 27/56] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:48:30.055659 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4a0b7faf-692e-42ac-aa00-9af319a0382c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:30.065234 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4a0b7faf-692e-42ac-aa00-9af319a0382c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:30.066946 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4a0b7faf-692e-42ac-aa00-9af319a0382c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:30.068111 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4a0b7faf-692e-42ac-aa00-9af319a0382c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.469893 Aug 24 17:48:30.082839 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 30/57] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:29 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:48:30.098476 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c62f5165-4bf1-478c-97c0-ddaec91a25d7 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:30.099311 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c62f5165-4bf1-478c-97c0-ddaec91a25d7 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:30.108228 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c62f5165-4bf1-478c-97c0-ddaec91a25d7 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:30.109069 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c62f5165-4bf1-478c-97c0-ddaec91a25d7 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:30.109574 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c62f5165-4bf1-478c-97c0-ddaec91a25d7 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:30.110494 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c62f5165-4bf1-478c-97c0-ddaec91a25d7 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:30.111932 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c62f5165-4bf1-478c-97c0-ddaec91a25d7 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:30.112569 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c62f5165-4bf1-478c-97c0-ddaec91a25d7 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:30.277664 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c62f5165-4bf1-478c-97c0-ddaec91a25d7 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:30.285931 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c62f5165-4bf1-478c-97c0-ddaec91a25d7 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.193594 Aug 24 17:48:30.288497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 28/58] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:30 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:30.960400 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3d73e284-b36b-4769-8b45-97d5fa0b826a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:30.961157 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3d73e284-b36b-4769-8b45-97d5fa0b826a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:30.978285 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3d73e284-b36b-4769-8b45-97d5fa0b826a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:30.978777 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3d73e284-b36b-4769-8b45-97d5fa0b826a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:30.979213 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3d73e284-b36b-4769-8b45-97d5fa0b826a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:30.984753 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3d73e284-b36b-4769-8b45-97d5fa0b826a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:30.985224 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3d73e284-b36b-4769-8b45-97d5fa0b826a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:30.987173 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3d73e284-b36b-4769-8b45-97d5fa0b826a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:30.998686 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=100 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:31.091492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6787319c-2bee-4358-93c7-0700bf8b088f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:31.092952 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6787319c-2bee-4358-93c7-0700bf8b088f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:31.103250 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6787319c-2bee-4358-93c7-0700bf8b088f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:31.107080 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6787319c-2bee-4358-93c7-0700bf8b088f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:31.107828 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6787319c-2bee-4358-93c7-0700bf8b088f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:31.108981 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6787319c-2bee-4358-93c7-0700bf8b088f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:31.109665 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6787319c-2bee-4358-93c7-0700bf8b088f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:31.110523 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6787319c-2bee-4358-93c7-0700bf8b088f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:31.311839 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3d73e284-b36b-4769-8b45-97d5fa0b826a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:31.325979 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3d73e284-b36b-4769-8b45-97d5fa0b826a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.385029 Aug 24 17:48:31.342436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 31/59] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:30 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:31.353380 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-db1932ab-77db-4d58-a3b1-5ef223f952a0 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:31.353945 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-db1932ab-77db-4d58-a3b1-5ef223f952a0 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:31.366924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-db1932ab-77db-4d58-a3b1-5ef223f952a0 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:31.367419 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-db1932ab-77db-4d58-a3b1-5ef223f952a0 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:31.370092 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-db1932ab-77db-4d58-a3b1-5ef223f952a0 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:31.372867 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-db1932ab-77db-4d58-a3b1-5ef223f952a0 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:31.373300 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-db1932ab-77db-4d58-a3b1-5ef223f952a0 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:31.373743 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-db1932ab-77db-4d58-a3b1-5ef223f952a0 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:31.396278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6787319c-2bee-4358-93c7-0700bf8b088f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:31.404056 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=100 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:31.409674 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6787319c-2bee-4358-93c7-0700bf8b088f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:31.412381 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6787319c-2bee-4358-93c7-0700bf8b088f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:31.414304 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6787319c-2bee-4358-93c7-0700bf8b088f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.327081 Aug 24 17:48:31.416531 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 29/60] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:31 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:31.593190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-db1932ab-77db-4d58-a3b1-5ef223f952a0 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:31.602955 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-db1932ab-77db-4d58-a3b1-5ef223f952a0 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.258728 Aug 24 17:48:31.603558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 32/61] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:31 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:31.743794 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-8aa1e881-dec8-4a1f-b0f8-672186847341 req-cd032cf2-1851-46ee-99dc-993ddda6553d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11705238-e9d4-4c1e-ab49-d5a27eb4df4c", "tag": "41c4ee25-50fb-45d7-9866-1d83514f02d5"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:31.768046 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-8aa1e881-dec8-4a1f-b0f8-672186847341 req-cd032cf2-1851-46ee-99dc-993ddda6553d service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:31.768533 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-8aa1e881-dec8-4a1f-b0f8-672186847341 req-cd032cf2-1851-46ee-99dc-993ddda6553d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:31.768997 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-8aa1e881-dec8-4a1f-b0f8-672186847341 req-cd032cf2-1851-46ee-99dc-993ddda6553d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:31.818341 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-8aa1e881-dec8-4a1f-b0f8-672186847341 req-cd032cf2-1851-46ee-99dc-993ddda6553d service nova] Creating event network-changed:41c4ee25-50fb-45d7-9866-1d83514f02d5 for instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c on hv-cinder-84052 Aug 24 17:48:31.833358 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-8aa1e881-dec8-4a1f-b0f8-672186847341 req-cd032cf2-1851-46ee-99dc-993ddda6553d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089507 Aug 24 17:48:31.834017 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 30/62] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:32.348270 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e8ec045d-6277-490f-a7aa-8933ad0ea4dc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:32.355834 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e8ec045d-6277-490f-a7aa-8933ad0ea4dc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:32.362919 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e8ec045d-6277-490f-a7aa-8933ad0ea4dc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:32.363979 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e8ec045d-6277-490f-a7aa-8933ad0ea4dc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:32.364614 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e8ec045d-6277-490f-a7aa-8933ad0ea4dc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:32.365326 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e8ec045d-6277-490f-a7aa-8933ad0ea4dc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:32.365782 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e8ec045d-6277-490f-a7aa-8933ad0ea4dc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:32.366206 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e8ec045d-6277-490f-a7aa-8933ad0ea4dc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:32.440424 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-15e7b76a-200a-4180-825a-d0283ae7d5d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:32.441580 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-15e7b76a-200a-4180-825a-d0283ae7d5d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:32.450404 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-15e7b76a-200a-4180-825a-d0283ae7d5d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:32.453505 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-15e7b76a-200a-4180-825a-d0283ae7d5d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:32.454811 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-15e7b76a-200a-4180-825a-d0283ae7d5d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:32.456743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-15e7b76a-200a-4180-825a-d0283ae7d5d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:32.458608 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-15e7b76a-200a-4180-825a-d0283ae7d5d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:32.459200 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-15e7b76a-200a-4180-825a-d0283ae7d5d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:32.510937 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e8ec045d-6277-490f-a7aa-8933ad0ea4dc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:32.534995 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e8ec045d-6277-490f-a7aa-8933ad0ea4dc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.191226 Aug 24 17:48:32.548970 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 33/63] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:32 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:32.630467 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9b587c64-ae95-4a88-b252-6498e3b7fc9f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:32.631733 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9b587c64-ae95-4a88-b252-6498e3b7fc9f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:32.643357 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9b587c64-ae95-4a88-b252-6498e3b7fc9f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:32.644387 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9b587c64-ae95-4a88-b252-6498e3b7fc9f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:32.644966 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9b587c64-ae95-4a88-b252-6498e3b7fc9f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:32.645833 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9b587c64-ae95-4a88-b252-6498e3b7fc9f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:32.647411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9b587c64-ae95-4a88-b252-6498e3b7fc9f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:32.648010 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9b587c64-ae95-4a88-b252-6498e3b7fc9f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:32.692138 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-15e7b76a-200a-4180-825a-d0283ae7d5d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:32.701584 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-15e7b76a-200a-4180-825a-d0283ae7d5d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:32.703642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-15e7b76a-200a-4180-825a-d0283ae7d5d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:32.705319 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-15e7b76a-200a-4180-825a-d0283ae7d5d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.271032 Aug 24 17:48:32.705886 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 31/64] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:32 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:32.911394 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9b587c64-ae95-4a88-b252-6498e3b7fc9f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:32.920387 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9b587c64-ae95-4a88-b252-6498e3b7fc9f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.299073 Aug 24 17:48:32.921276 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 34/65] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:32 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:33.558623 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b8bc12d5-72c3-4bd9-ad38-ca5924e12960 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:33.560071 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b8bc12d5-72c3-4bd9-ad38-ca5924e12960 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:33.574265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8bc12d5-72c3-4bd9-ad38-ca5924e12960 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:33.576507 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8bc12d5-72c3-4bd9-ad38-ca5924e12960 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:33.578698 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8bc12d5-72c3-4bd9-ad38-ca5924e12960 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:33.583309 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8bc12d5-72c3-4bd9-ad38-ca5924e12960 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:33.583861 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8bc12d5-72c3-4bd9-ad38-ca5924e12960 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:33.584302 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8bc12d5-72c3-4bd9-ad38-ca5924e12960 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:33.731038 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f56c8879-94f9-4122-b623-4a4693771dbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:33.732863 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f56c8879-94f9-4122-b623-4a4693771dbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:33.745949 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f56c8879-94f9-4122-b623-4a4693771dbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:33.747866 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f56c8879-94f9-4122-b623-4a4693771dbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:33.748706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f56c8879-94f9-4122-b623-4a4693771dbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:33.751079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f56c8879-94f9-4122-b623-4a4693771dbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:33.752877 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f56c8879-94f9-4122-b623-4a4693771dbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:33.753920 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f56c8879-94f9-4122-b623-4a4693771dbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:33.803180 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b8bc12d5-72c3-4bd9-ad38-ca5924e12960 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:33.811555 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b8bc12d5-72c3-4bd9-ad38-ca5924e12960 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.259890 Aug 24 17:48:33.813677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 32/66] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:33 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:33.942944 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b2661a75-fc7a-4a9f-8c1d-09ae5ef5e41d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:33.943592 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b2661a75-fc7a-4a9f-8c1d-09ae5ef5e41d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:33.949828 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2661a75-fc7a-4a9f-8c1d-09ae5ef5e41d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:33.950306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2661a75-fc7a-4a9f-8c1d-09ae5ef5e41d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:33.950739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2661a75-fc7a-4a9f-8c1d-09ae5ef5e41d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:33.951441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2661a75-fc7a-4a9f-8c1d-09ae5ef5e41d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:33.951920 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2661a75-fc7a-4a9f-8c1d-09ae5ef5e41d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:33.952727 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2661a75-fc7a-4a9f-8c1d-09ae5ef5e41d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:33.970374 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f56c8879-94f9-4122-b623-4a4693771dbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:33.982869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f56c8879-94f9-4122-b623-4a4693771dbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:33.984775 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f56c8879-94f9-4122-b623-4a4693771dbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:33.986728 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f56c8879-94f9-4122-b623-4a4693771dbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.260432 Aug 24 17:48:33.987699 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 35/67] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:33 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:34.108682 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b2661a75-fc7a-4a9f-8c1d-09ae5ef5e41d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:34.118025 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b2661a75-fc7a-4a9f-8c1d-09ae5ef5e41d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.179490 Aug 24 17:48:34.126789 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 33/68] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:33 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:34.834039 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-837165f2-cae6-4592-8f1d-73fc2b5c9157 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:34.835792 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-837165f2-cae6-4592-8f1d-73fc2b5c9157 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:34.852112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:34.852112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-837165f2-cae6-4592-8f1d-73fc2b5c9157 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:34.852112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-837165f2-cae6-4592-8f1d-73fc2b5c9157 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:34.852112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-837165f2-cae6-4592-8f1d-73fc2b5c9157 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:34.853255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-837165f2-cae6-4592-8f1d-73fc2b5c9157 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:34.853255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-837165f2-cae6-4592-8f1d-73fc2b5c9157 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:34.853255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-837165f2-cae6-4592-8f1d-73fc2b5c9157 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:35.012972 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d9032aab-0cb9-4761-89dd-a51a232824b5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:35.014536 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d9032aab-0cb9-4761-89dd-a51a232824b5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:35.020414 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-837165f2-cae6-4592-8f1d-73fc2b5c9157 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:35.021589 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d9032aab-0cb9-4761-89dd-a51a232824b5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:35.022190 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d9032aab-0cb9-4761-89dd-a51a232824b5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:35.022730 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d9032aab-0cb9-4761-89dd-a51a232824b5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:35.023563 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d9032aab-0cb9-4761-89dd-a51a232824b5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:35.024350 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d9032aab-0cb9-4761-89dd-a51a232824b5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:35.024987 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d9032aab-0cb9-4761-89dd-a51a232824b5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:35.030918 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-837165f2-cae6-4592-8f1d-73fc2b5c9157 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.201151 Aug 24 17:48:35.031530 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 36/69] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:34 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:35.140081 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6b5eb128-f95a-473a-b931-4ee7880bce5b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:35.140840 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-6b5eb128-f95a-473a-b931-4ee7880bce5b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:35.148292 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b5eb128-f95a-473a-b931-4ee7880bce5b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:35.149024 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b5eb128-f95a-473a-b931-4ee7880bce5b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:35.150722 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b5eb128-f95a-473a-b931-4ee7880bce5b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:35.151945 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b5eb128-f95a-473a-b931-4ee7880bce5b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:35.152625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b5eb128-f95a-473a-b931-4ee7880bce5b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:35.153238 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b5eb128-f95a-473a-b931-4ee7880bce5b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:35.179328 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d9032aab-0cb9-4761-89dd-a51a232824b5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:35.189612 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d9032aab-0cb9-4761-89dd-a51a232824b5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:35.191623 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d9032aab-0cb9-4761-89dd-a51a232824b5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:35.193020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d9032aab-0cb9-4761-89dd-a51a232824b5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.185332 Aug 24 17:48:35.193931 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 34/70] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:35 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:48:35.326707 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6b5eb128-f95a-473a-b931-4ee7880bce5b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:35.337344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6b5eb128-f95a-473a-b931-4ee7880bce5b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.202454 Aug 24 17:48:35.338162 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 37/71] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:35 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:36.055159 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e09beca9-3c3f-422b-84cf-62d0743e1714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:36.056497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e09beca9-3c3f-422b-84cf-62d0743e1714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:36.059643 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:36.064346 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e09beca9-3c3f-422b-84cf-62d0743e1714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:36.064843 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e09beca9-3c3f-422b-84cf-62d0743e1714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:36.065618 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e09beca9-3c3f-422b-84cf-62d0743e1714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:36.066419 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e09beca9-3c3f-422b-84cf-62d0743e1714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:36.066965 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e09beca9-3c3f-422b-84cf-62d0743e1714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:36.067379 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e09beca9-3c3f-422b-84cf-62d0743e1714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:36.213233 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e09beca9-3c3f-422b-84cf-62d0743e1714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:36.221652 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9d85bd6e-be71-4d1a-8d09-a30786f2ed2e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:36.222289 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9d85bd6e-be71-4d1a-8d09-a30786f2ed2e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:36.224386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e09beca9-3c3f-422b-84cf-62d0743e1714 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.173789 Aug 24 17:48:36.225124 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 35/72] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:36 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:36.230873 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9d85bd6e-be71-4d1a-8d09-a30786f2ed2e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:36.231361 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9d85bd6e-be71-4d1a-8d09-a30786f2ed2e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:36.231829 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9d85bd6e-be71-4d1a-8d09-a30786f2ed2e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:36.232531 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9d85bd6e-be71-4d1a-8d09-a30786f2ed2e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:36.232992 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9d85bd6e-be71-4d1a-8d09-a30786f2ed2e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:36.233416 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9d85bd6e-be71-4d1a-8d09-a30786f2ed2e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:36.360984 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-315747bb-eb42-48d8-afa2-2a13bc4475d4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:36.364093 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-315747bb-eb42-48d8-afa2-2a13bc4475d4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:36.382399 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-315747bb-eb42-48d8-afa2-2a13bc4475d4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:36.384750 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-315747bb-eb42-48d8-afa2-2a13bc4475d4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:36.387112 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-315747bb-eb42-48d8-afa2-2a13bc4475d4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:36.392315 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-315747bb-eb42-48d8-afa2-2a13bc4475d4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:36.393012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-315747bb-eb42-48d8-afa2-2a13bc4475d4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:36.393740 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-315747bb-eb42-48d8-afa2-2a13bc4475d4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:36.597202 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9d85bd6e-be71-4d1a-8d09-a30786f2ed2e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:36.610214 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9d85bd6e-be71-4d1a-8d09-a30786f2ed2e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:36.618926 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9d85bd6e-be71-4d1a-8d09-a30786f2ed2e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:36.622645 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9d85bd6e-be71-4d1a-8d09-a30786f2ed2e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.408120 Aug 24 17:48:36.626538 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 38/73] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:36 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:37.078729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-315747bb-eb42-48d8-afa2-2a13bc4475d4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:37.096368 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-315747bb-eb42-48d8-afa2-2a13bc4475d4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.740951 Aug 24 17:48:37.097309 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 36/74] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:36 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:37.251631 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5eb7ed96-12c1-47fe-b92a-cfe5dc0cc087 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:37.253463 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5eb7ed96-12c1-47fe-b92a-cfe5dc0cc087 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:37.272689 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5eb7ed96-12c1-47fe-b92a-cfe5dc0cc087 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:37.275208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5eb7ed96-12c1-47fe-b92a-cfe5dc0cc087 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:37.276114 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5eb7ed96-12c1-47fe-b92a-cfe5dc0cc087 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:37.277383 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5eb7ed96-12c1-47fe-b92a-cfe5dc0cc087 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:37.280576 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5eb7ed96-12c1-47fe-b92a-cfe5dc0cc087 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:37.281195 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5eb7ed96-12c1-47fe-b92a-cfe5dc0cc087 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:37.558976 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5eb7ed96-12c1-47fe-b92a-cfe5dc0cc087 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:37.568846 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5eb7ed96-12c1-47fe-b92a-cfe5dc0cc087 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.326773 Aug 24 17:48:37.580005 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 39/75] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:37 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:37.653560 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-efd5db8a-1752-4b6a-95c7-4efb9debd34b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:37.654174 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-efd5db8a-1752-4b6a-95c7-4efb9debd34b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:37.660423 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-efd5db8a-1752-4b6a-95c7-4efb9debd34b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:37.660914 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-efd5db8a-1752-4b6a-95c7-4efb9debd34b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:37.661349 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-efd5db8a-1752-4b6a-95c7-4efb9debd34b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:37.662216 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-efd5db8a-1752-4b6a-95c7-4efb9debd34b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:37.662844 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-efd5db8a-1752-4b6a-95c7-4efb9debd34b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:37.663618 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-efd5db8a-1752-4b6a-95c7-4efb9debd34b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:38.079394 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-efd5db8a-1752-4b6a-95c7-4efb9debd34b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:38.090629 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-efd5db8a-1752-4b6a-95c7-4efb9debd34b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:38.092332 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-efd5db8a-1752-4b6a-95c7-4efb9debd34b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:38.093448 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-efd5db8a-1752-4b6a-95c7-4efb9debd34b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.443767 Aug 24 17:48:38.094279 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 37/76] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:37 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:48:38.122478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d0118454-0207-42fb-88fe-100b6103b094 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:38.123113 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d0118454-0207-42fb-88fe-100b6103b094 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:38.126348 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:38.130450 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d0118454-0207-42fb-88fe-100b6103b094 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:38.130939 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d0118454-0207-42fb-88fe-100b6103b094 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:38.131398 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d0118454-0207-42fb-88fe-100b6103b094 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:38.132122 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d0118454-0207-42fb-88fe-100b6103b094 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:38.132575 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d0118454-0207-42fb-88fe-100b6103b094 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:38.132997 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d0118454-0207-42fb-88fe-100b6103b094 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:38.265984 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d0118454-0207-42fb-88fe-100b6103b094 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:38.274890 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d0118454-0207-42fb-88fe-100b6103b094 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.156959 Aug 24 17:48:38.275585 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 40/77] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:38 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:38.593569 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e8df6456-ec24-4694-b418-62e419b8d3d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:38.594437 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e8df6456-ec24-4694-b418-62e419b8d3d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:38.600295 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e8df6456-ec24-4694-b418-62e419b8d3d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:38.600773 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e8df6456-ec24-4694-b418-62e419b8d3d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:38.601201 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e8df6456-ec24-4694-b418-62e419b8d3d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:38.602041 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e8df6456-ec24-4694-b418-62e419b8d3d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:38.602365 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e8df6456-ec24-4694-b418-62e419b8d3d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:38.602798 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e8df6456-ec24-4694-b418-62e419b8d3d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:38.736047 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e8df6456-ec24-4694-b418-62e419b8d3d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:38.743718 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e8df6456-ec24-4694-b418-62e419b8d3d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.153832 Aug 24 17:48:38.744300 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 38/78] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:38 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:39.116476 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c300b260-fe4e-4f7d-961e-206d9781b7de tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:39.118954 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c300b260-fe4e-4f7d-961e-206d9781b7de tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:39.127064 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c300b260-fe4e-4f7d-961e-206d9781b7de tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:39.127751 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c300b260-fe4e-4f7d-961e-206d9781b7de tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:39.128340 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c300b260-fe4e-4f7d-961e-206d9781b7de tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:39.129199 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c300b260-fe4e-4f7d-961e-206d9781b7de tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:39.129810 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c300b260-fe4e-4f7d-961e-206d9781b7de tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:39.130535 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c300b260-fe4e-4f7d-961e-206d9781b7de tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:39.297853 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-cfe6b513-afa7-4439-ac1f-7572709aa12d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:39.298413 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-cfe6b513-afa7-4439-ac1f-7572709aa12d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:39.309816 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cfe6b513-afa7-4439-ac1f-7572709aa12d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:39.310769 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cfe6b513-afa7-4439-ac1f-7572709aa12d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:39.311464 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cfe6b513-afa7-4439-ac1f-7572709aa12d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:39.312821 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cfe6b513-afa7-4439-ac1f-7572709aa12d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:39.313966 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cfe6b513-afa7-4439-ac1f-7572709aa12d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:39.314952 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cfe6b513-afa7-4439-ac1f-7572709aa12d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:39.396042 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c300b260-fe4e-4f7d-961e-206d9781b7de tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:39.413461 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c300b260-fe4e-4f7d-961e-206d9781b7de tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:39.417731 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c300b260-fe4e-4f7d-961e-206d9781b7de tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:39.419382 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c300b260-fe4e-4f7d-961e-206d9781b7de tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.306831 Aug 24 17:48:39.420826 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 41/79] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:39 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:39.541106 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-cfe6b513-afa7-4439-ac1f-7572709aa12d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:39.550474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-cfe6b513-afa7-4439-ac1f-7572709aa12d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.258382 Aug 24 17:48:39.551534 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 39/80] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:39 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:39.765501 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c6ab2c67-3ed5-4939-946c-76a919187450 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:39.766865 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c6ab2c67-3ed5-4939-946c-76a919187450 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:39.774237 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c6ab2c67-3ed5-4939-946c-76a919187450 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:39.774964 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c6ab2c67-3ed5-4939-946c-76a919187450 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:39.775605 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c6ab2c67-3ed5-4939-946c-76a919187450 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:39.776536 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c6ab2c67-3ed5-4939-946c-76a919187450 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:39.776939 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c6ab2c67-3ed5-4939-946c-76a919187450 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:39.777370 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c6ab2c67-3ed5-4939-946c-76a919187450 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:40.050180 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c6ab2c67-3ed5-4939-946c-76a919187450 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:40.059757 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c6ab2c67-3ed5-4939-946c-76a919187450 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.298202 Aug 24 17:48:40.073266 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 42/81] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:39 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:40.445320 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d15f85cf-9c85-4f7c-838e-fddec37ac6c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:40.446733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d15f85cf-9c85-4f7c-838e-fddec37ac6c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:40.449087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:40.455283 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d15f85cf-9c85-4f7c-838e-fddec37ac6c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:40.455803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d15f85cf-9c85-4f7c-838e-fddec37ac6c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:40.456378 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d15f85cf-9c85-4f7c-838e-fddec37ac6c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:40.457277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d15f85cf-9c85-4f7c-838e-fddec37ac6c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:40.457889 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d15f85cf-9c85-4f7c-838e-fddec37ac6c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:40.458316 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d15f85cf-9c85-4f7c-838e-fddec37ac6c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:40.571291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-de6c7943-829e-4e1f-8728-87862c87ed78 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:40.572543 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-de6c7943-829e-4e1f-8728-87862c87ed78 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:40.582267 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-de6c7943-829e-4e1f-8728-87862c87ed78 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:40.582919 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-de6c7943-829e-4e1f-8728-87862c87ed78 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:40.583523 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-de6c7943-829e-4e1f-8728-87862c87ed78 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:40.584373 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-de6c7943-829e-4e1f-8728-87862c87ed78 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:40.584998 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-de6c7943-829e-4e1f-8728-87862c87ed78 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:40.586221 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-de6c7943-829e-4e1f-8728-87862c87ed78 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:40.626291 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d15f85cf-9c85-4f7c-838e-fddec37ac6c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:40.636789 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d15f85cf-9c85-4f7c-838e-fddec37ac6c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:40.638866 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d15f85cf-9c85-4f7c-838e-fddec37ac6c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:40.640410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d15f85cf-9c85-4f7c-838e-fddec37ac6c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.199158 Aug 24 17:48:40.652004 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 40/82] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:40 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:40.736966 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-de6c7943-829e-4e1f-8728-87862c87ed78 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:40.744799 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-de6c7943-829e-4e1f-8728-87862c87ed78 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.177336 Aug 24 17:48:40.745719 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 43/83] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:40 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:41.087426 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-50d7273a-7494-4c62-85f5-c2a80d0334d2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:41.088113 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-50d7273a-7494-4c62-85f5-c2a80d0334d2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:41.099328 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-50d7273a-7494-4c62-85f5-c2a80d0334d2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:41.101094 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-50d7273a-7494-4c62-85f5-c2a80d0334d2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:41.103768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-50d7273a-7494-4c62-85f5-c2a80d0334d2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:41.104969 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-50d7273a-7494-4c62-85f5-c2a80d0334d2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:41.105936 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-50d7273a-7494-4c62-85f5-c2a80d0334d2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:41.106800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-50d7273a-7494-4c62-85f5-c2a80d0334d2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:41.268330 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-50d7273a-7494-4c62-85f5-c2a80d0334d2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:41.277450 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-50d7273a-7494-4c62-85f5-c2a80d0334d2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.198884 Aug 24 17:48:41.278024 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 41/84] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:41 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:41.663303 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-33dfa735-8bae-4283-9b26-92720c12d42f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:41.664062 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-33dfa735-8bae-4283-9b26-92720c12d42f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:41.670498 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33dfa735-8bae-4283-9b26-92720c12d42f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:41.671071 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33dfa735-8bae-4283-9b26-92720c12d42f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:41.671606 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33dfa735-8bae-4283-9b26-92720c12d42f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:41.672506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33dfa735-8bae-4283-9b26-92720c12d42f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:41.672962 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33dfa735-8bae-4283-9b26-92720c12d42f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:41.673382 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33dfa735-8bae-4283-9b26-92720c12d42f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:41.765818 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d463d1b1-e432-4100-aee4-322757f4d1d9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:41.766680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d463d1b1-e432-4100-aee4-322757f4d1d9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:41.774784 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d463d1b1-e432-4100-aee4-322757f4d1d9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:41.776364 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d463d1b1-e432-4100-aee4-322757f4d1d9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:41.777200 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d463d1b1-e432-4100-aee4-322757f4d1d9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:41.778289 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d463d1b1-e432-4100-aee4-322757f4d1d9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:41.778976 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d463d1b1-e432-4100-aee4-322757f4d1d9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:41.779668 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d463d1b1-e432-4100-aee4-322757f4d1d9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:41.841513 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-33dfa735-8bae-4283-9b26-92720c12d42f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:41.850432 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-33dfa735-8bae-4283-9b26-92720c12d42f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:41.852035 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-33dfa735-8bae-4283-9b26-92720c12d42f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:41.853335 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-33dfa735-8bae-4283-9b26-92720c12d42f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.194032 Aug 24 17:48:41.854082 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 44/85] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:41 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:41.957379 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d463d1b1-e432-4100-aee4-322757f4d1d9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:41.970604 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d463d1b1-e432-4100-aee4-322757f4d1d9 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.208805 Aug 24 17:48:41.975940 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 42/86] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:41 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:42.301101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-bf4df1e9-5fe3-4b3a-a01d-3d7d1dc3e366 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:42.301891 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-bf4df1e9-5fe3-4b3a-a01d-3d7d1dc3e366 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:42.310521 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bf4df1e9-5fe3-4b3a-a01d-3d7d1dc3e366 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:42.311136 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bf4df1e9-5fe3-4b3a-a01d-3d7d1dc3e366 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:42.311722 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bf4df1e9-5fe3-4b3a-a01d-3d7d1dc3e366 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:42.312527 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bf4df1e9-5fe3-4b3a-a01d-3d7d1dc3e366 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:42.313184 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bf4df1e9-5fe3-4b3a-a01d-3d7d1dc3e366 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:42.313806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bf4df1e9-5fe3-4b3a-a01d-3d7d1dc3e366 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:42.458654 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bf4df1e9-5fe3-4b3a-a01d-3d7d1dc3e366 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:42.467312 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-bf4df1e9-5fe3-4b3a-a01d-3d7d1dc3e366 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.170166 Aug 24 17:48:42.467930 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 45/87] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:42 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:42.877412 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f08a2e54-faa9-410f-a678-565c05b61971 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:42.879951 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f08a2e54-faa9-410f-a678-565c05b61971 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:42.887195 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f08a2e54-faa9-410f-a678-565c05b61971 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:42.888092 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f08a2e54-faa9-410f-a678-565c05b61971 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:42.888718 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f08a2e54-faa9-410f-a678-565c05b61971 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:42.889724 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f08a2e54-faa9-410f-a678-565c05b61971 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:42.890340 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f08a2e54-faa9-410f-a678-565c05b61971 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:42.890915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f08a2e54-faa9-410f-a678-565c05b61971 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:42.996901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ae14b8f4-6b61-4fe4-bf3d-319565f6c918 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:42.997615 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ae14b8f4-6b61-4fe4-bf3d-319565f6c918 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:43.003867 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ae14b8f4-6b61-4fe4-bf3d-319565f6c918 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:43.004748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ae14b8f4-6b61-4fe4-bf3d-319565f6c918 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:43.005375 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ae14b8f4-6b61-4fe4-bf3d-319565f6c918 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:43.006268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ae14b8f4-6b61-4fe4-bf3d-319565f6c918 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:43.006906 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ae14b8f4-6b61-4fe4-bf3d-319565f6c918 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:43.007563 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ae14b8f4-6b61-4fe4-bf3d-319565f6c918 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:43.051190 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f08a2e54-faa9-410f-a678-565c05b61971 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:43.060862 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f08a2e54-faa9-410f-a678-565c05b61971 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:43.062422 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f08a2e54-faa9-410f-a678-565c05b61971 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:43.063559 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-f08a2e54-faa9-410f-a678-565c05b61971 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.190901 Aug 24 17:48:43.064119 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 43/88] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:42 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:43.192318 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ae14b8f4-6b61-4fe4-bf3d-319565f6c918 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:43.200591 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ae14b8f4-6b61-4fe4-bf3d-319565f6c918 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.212201 Aug 24 17:48:43.201159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 46/89] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:42 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:43.489034 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-dbae7a26-cdcc-45ad-96ed-1bbaa87053cc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:43.489653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-dbae7a26-cdcc-45ad-96ed-1bbaa87053cc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:43.495617 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dbae7a26-cdcc-45ad-96ed-1bbaa87053cc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:43.496108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dbae7a26-cdcc-45ad-96ed-1bbaa87053cc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:43.496550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dbae7a26-cdcc-45ad-96ed-1bbaa87053cc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:43.497242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dbae7a26-cdcc-45ad-96ed-1bbaa87053cc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:43.497700 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dbae7a26-cdcc-45ad-96ed-1bbaa87053cc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:43.498127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dbae7a26-cdcc-45ad-96ed-1bbaa87053cc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:43.649755 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-dbae7a26-cdcc-45ad-96ed-1bbaa87053cc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:43.657952 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-dbae7a26-cdcc-45ad-96ed-1bbaa87053cc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.172652 Aug 24 17:48:43.658565 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 44/90] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:43 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:44.087272 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5e32936c-c938-4ac1-8270-4811d510aa0a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:44.088004 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5e32936c-c938-4ac1-8270-4811d510aa0a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:44.094979 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5e32936c-c938-4ac1-8270-4811d510aa0a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:44.095585 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5e32936c-c938-4ac1-8270-4811d510aa0a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:44.096040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5e32936c-c938-4ac1-8270-4811d510aa0a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:44.096794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5e32936c-c938-4ac1-8270-4811d510aa0a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:44.097256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5e32936c-c938-4ac1-8270-4811d510aa0a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:44.097678 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5e32936c-c938-4ac1-8270-4811d510aa0a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:44.222045 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7405a4e1-38d9-40b6-974d-cf8742339bfb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:44.222671 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7405a4e1-38d9-40b6-974d-cf8742339bfb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:44.228859 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7405a4e1-38d9-40b6-974d-cf8742339bfb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:44.229354 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7405a4e1-38d9-40b6-974d-cf8742339bfb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:44.230566 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7405a4e1-38d9-40b6-974d-cf8742339bfb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:44.231447 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7405a4e1-38d9-40b6-974d-cf8742339bfb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:44.231942 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7405a4e1-38d9-40b6-974d-cf8742339bfb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:44.232370 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7405a4e1-38d9-40b6-974d-cf8742339bfb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:44.246733 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5e32936c-c938-4ac1-8270-4811d510aa0a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:44.250328 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=100 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:44.256035 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5e32936c-c938-4ac1-8270-4811d510aa0a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:44.257529 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5e32936c-c938-4ac1-8270-4811d510aa0a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:44.259193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5e32936c-c938-4ac1-8270-4811d510aa0a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.176661 Aug 24 17:48:44.260070 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 47/91] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:44 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:44.380142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7405a4e1-38d9-40b6-974d-cf8742339bfb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:44.388338 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7405a4e1-38d9-40b6-974d-cf8742339bfb tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.170519 Aug 24 17:48:44.388904 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 45/92] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:44 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:44.678624 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3ff7d287-aee5-4b5a-a4f4-3f484b6cfb0f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:44.679384 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3ff7d287-aee5-4b5a-a4f4-3f484b6cfb0f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:44.686244 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ff7d287-aee5-4b5a-a4f4-3f484b6cfb0f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:44.686862 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ff7d287-aee5-4b5a-a4f4-3f484b6cfb0f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:44.687425 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ff7d287-aee5-4b5a-a4f4-3f484b6cfb0f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:44.688278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ff7d287-aee5-4b5a-a4f4-3f484b6cfb0f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:44.688827 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ff7d287-aee5-4b5a-a4f4-3f484b6cfb0f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:44.689490 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ff7d287-aee5-4b5a-a4f4-3f484b6cfb0f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:44.836316 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3ff7d287-aee5-4b5a-a4f4-3f484b6cfb0f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:44.844537 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3ff7d287-aee5-4b5a-a4f4-3f484b6cfb0f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.170156 Aug 24 17:48:44.845218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 48/93] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:44 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:45.281845 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9cfc9cc8-57fe-4270-970f-625e388fc25d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:45.282535 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9cfc9cc8-57fe-4270-970f-625e388fc25d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:45.294519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9cfc9cc8-57fe-4270-970f-625e388fc25d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:45.297140 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9cfc9cc8-57fe-4270-970f-625e388fc25d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:45.297766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9cfc9cc8-57fe-4270-970f-625e388fc25d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:45.298983 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9cfc9cc8-57fe-4270-970f-625e388fc25d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:45.299953 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9cfc9cc8-57fe-4270-970f-625e388fc25d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:45.303776 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9cfc9cc8-57fe-4270-970f-625e388fc25d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:45.408116 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-21a442ab-a5e2-4ea4-a8e7-71c8568b52d5 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:45.409134 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-21a442ab-a5e2-4ea4-a8e7-71c8568b52d5 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:45.416538 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21a442ab-a5e2-4ea4-a8e7-71c8568b52d5 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:45.417087 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21a442ab-a5e2-4ea4-a8e7-71c8568b52d5 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:45.417688 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21a442ab-a5e2-4ea4-a8e7-71c8568b52d5 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:45.418535 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21a442ab-a5e2-4ea4-a8e7-71c8568b52d5 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:45.419128 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21a442ab-a5e2-4ea4-a8e7-71c8568b52d5 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:45.419759 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21a442ab-a5e2-4ea4-a8e7-71c8568b52d5 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:45.530931 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9cfc9cc8-57fe-4270-970f-625e388fc25d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:45.541427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9cfc9cc8-57fe-4270-970f-625e388fc25d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:45.543645 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9cfc9cc8-57fe-4270-970f-625e388fc25d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:45.544928 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9cfc9cc8-57fe-4270-970f-625e388fc25d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.267959 Aug 24 17:48:45.560009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 46/94] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:45 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:45.589633 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-21a442ab-a5e2-4ea4-a8e7-71c8568b52d5 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:45.598593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-21a442ab-a5e2-4ea4-a8e7-71c8568b52d5 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.194225 Aug 24 17:48:45.599146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 49/95] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:45 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:45.866070 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3ff82d02-d2fa-4711-bbb4-2a0f98ba3123 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:45.868178 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3ff82d02-d2fa-4711-bbb4-2a0f98ba3123 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:45.878604 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ff82d02-d2fa-4711-bbb4-2a0f98ba3123 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:45.879420 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ff82d02-d2fa-4711-bbb4-2a0f98ba3123 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:45.880776 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ff82d02-d2fa-4711-bbb4-2a0f98ba3123 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:45.882065 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ff82d02-d2fa-4711-bbb4-2a0f98ba3123 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:45.884132 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ff82d02-d2fa-4711-bbb4-2a0f98ba3123 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:45.885191 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ff82d02-d2fa-4711-bbb4-2a0f98ba3123 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:45.894316 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=100 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:46.058871 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-3ff82d02-d2fa-4711-bbb4-2a0f98ba3123 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:46.068387 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-3ff82d02-d2fa-4711-bbb4-2a0f98ba3123 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.207119 Aug 24 17:48:46.068971 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 47/96] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:45 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:46.449324 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-3c3465ea-66ee-42cf-a594-1fd302d03b59 req-3be819e8-4a0c-4b30-83df-138d93925b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca739a9-de86-4fb2-b047-7bc75fa540bb", "name": "network-vif-plugged", "status": "completed", "tag": "8a5ff39c-8fa9-4c77-85a2-b39dce880069"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:46.458665 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-3c3465ea-66ee-42cf-a594-1fd302d03b59 req-3be819e8-4a0c-4b30-83df-138d93925b96 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:46.459149 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-3c3465ea-66ee-42cf-a594-1fd302d03b59 req-3be819e8-4a0c-4b30-83df-138d93925b96 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:46.459608 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-3c3465ea-66ee-42cf-a594-1fd302d03b59 req-3be819e8-4a0c-4b30-83df-138d93925b96 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:46.471735 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-3c3465ea-66ee-42cf-a594-1fd302d03b59 req-3be819e8-4a0c-4b30-83df-138d93925b96 service nova] Creating event network-vif-plugged:8a5ff39c-8fa9-4c77-85a2-b39dce880069 for instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb on hv-cinder-84052 Aug 24 17:48:46.477347 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-3c3465ea-66ee-42cf-a594-1fd302d03b59 req-3be819e8-4a0c-4b30-83df-138d93925b96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093894 Aug 24 17:48:46.478110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 50/97] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:46.567941 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-21010f50-c125-44c3-83b2-46a791f84a10 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:46.568618 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-21010f50-c125-44c3-83b2-46a791f84a10 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:46.574620 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-21010f50-c125-44c3-83b2-46a791f84a10 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:46.575105 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-21010f50-c125-44c3-83b2-46a791f84a10 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:46.575588 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-21010f50-c125-44c3-83b2-46a791f84a10 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:46.576281 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-21010f50-c125-44c3-83b2-46a791f84a10 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:46.576936 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-21010f50-c125-44c3-83b2-46a791f84a10 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:46.577359 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-21010f50-c125-44c3-83b2-46a791f84a10 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:46.621249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a8774caa-756a-440f-ac1d-4215400b3538 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:46.622012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a8774caa-756a-440f-ac1d-4215400b3538 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:46.628389 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8774caa-756a-440f-ac1d-4215400b3538 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:46.628943 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8774caa-756a-440f-ac1d-4215400b3538 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:46.629389 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8774caa-756a-440f-ac1d-4215400b3538 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:46.630083 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8774caa-756a-440f-ac1d-4215400b3538 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:46.630536 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8774caa-756a-440f-ac1d-4215400b3538 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:46.631155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8774caa-756a-440f-ac1d-4215400b3538 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:46.721979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-21010f50-c125-44c3-83b2-46a791f84a10 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:46.730936 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-21010f50-c125-44c3-83b2-46a791f84a10 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:46.732796 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-21010f50-c125-44c3-83b2-46a791f84a10 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:46.734012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-21010f50-c125-44c3-83b2-46a791f84a10 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.170158 Aug 24 17:48:46.734648 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 48/98] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:46 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:46.778931 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a8774caa-756a-440f-ac1d-4215400b3538 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:46.787854 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a8774caa-756a-440f-ac1d-4215400b3538 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.170898 Aug 24 17:48:46.788714 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 51/99] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:46 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:47.094362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b3fbff2a-d669-4b39-af6b-c06d792dccd8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:47.095256 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b3fbff2a-d669-4b39-af6b-c06d792dccd8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:47.101556 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b3fbff2a-d669-4b39-af6b-c06d792dccd8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:47.102187 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b3fbff2a-d669-4b39-af6b-c06d792dccd8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:47.102799 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b3fbff2a-d669-4b39-af6b-c06d792dccd8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:47.103618 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b3fbff2a-d669-4b39-af6b-c06d792dccd8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:47.104072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b3fbff2a-d669-4b39-af6b-c06d792dccd8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:47.104689 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b3fbff2a-d669-4b39-af6b-c06d792dccd8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:47.261743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b3fbff2a-d669-4b39-af6b-c06d792dccd8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:47.270883 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b3fbff2a-d669-4b39-af6b-c06d792dccd8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.180544 Aug 24 17:48:47.271580 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 49/100] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:47 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:47.756351 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d37b990c-cf43-474e-bc27-6229d5d7adb3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:47.756959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d37b990c-cf43-474e-bc27-6229d5d7adb3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:47.763191 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d37b990c-cf43-474e-bc27-6229d5d7adb3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:47.763708 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d37b990c-cf43-474e-bc27-6229d5d7adb3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:47.764136 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d37b990c-cf43-474e-bc27-6229d5d7adb3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:47.764810 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d37b990c-cf43-474e-bc27-6229d5d7adb3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:47.765257 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d37b990c-cf43-474e-bc27-6229d5d7adb3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:47.765701 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d37b990c-cf43-474e-bc27-6229d5d7adb3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:47.809038 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7082a996-80f8-4471-a2b6-5d5b3e40e936 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:47.809648 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7082a996-80f8-4471-a2b6-5d5b3e40e936 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:47.816123 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7082a996-80f8-4471-a2b6-5d5b3e40e936 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:47.816596 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7082a996-80f8-4471-a2b6-5d5b3e40e936 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:47.817196 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7082a996-80f8-4471-a2b6-5d5b3e40e936 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:47.818029 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7082a996-80f8-4471-a2b6-5d5b3e40e936 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:47.818486 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7082a996-80f8-4471-a2b6-5d5b3e40e936 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:47.818905 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7082a996-80f8-4471-a2b6-5d5b3e40e936 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:47.918208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d37b990c-cf43-474e-bc27-6229d5d7adb3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:47.927266 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d37b990c-cf43-474e-bc27-6229d5d7adb3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:47.928799 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d37b990c-cf43-474e-bc27-6229d5d7adb3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:47.929923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d37b990c-cf43-474e-bc27-6229d5d7adb3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.177355 Aug 24 17:48:47.931951 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 52/101] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:47 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:47.960825 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7082a996-80f8-4471-a2b6-5d5b3e40e936 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:47.969227 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7082a996-80f8-4471-a2b6-5d5b3e40e936 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.164517 Aug 24 17:48:47.969788 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 50/102] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:47 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:48.291550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-794266fa-0cc3-48d6-af0e-8dfe2c328143 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:48.292172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-794266fa-0cc3-48d6-af0e-8dfe2c328143 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:48.298290 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-794266fa-0cc3-48d6-af0e-8dfe2c328143 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:48.298678 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-794266fa-0cc3-48d6-af0e-8dfe2c328143 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:48.299113 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-794266fa-0cc3-48d6-af0e-8dfe2c328143 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:48.299852 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-794266fa-0cc3-48d6-af0e-8dfe2c328143 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:48.300306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-794266fa-0cc3-48d6-af0e-8dfe2c328143 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:48.300735 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-794266fa-0cc3-48d6-af0e-8dfe2c328143 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:48.432865 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-794266fa-0cc3-48d6-af0e-8dfe2c328143 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:48.440396 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-794266fa-0cc3-48d6-af0e-8dfe2c328143 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.152702 Aug 24 17:48:48.440960 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 53/103] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:48 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:48.493148 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-86b718d1-2da3-44c4-aa1e-2a8fca99b707 req-1ab80549-1615-4499-8fbe-07af4625007d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0397fbeb-25d8-46af-98bb-8a7b70c97f48", "name": "network-vif-plugged", "status": "completed", "tag": "87b079d0-f5b8-4315-b27a-8988f8c98b86"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:48.502645 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-86b718d1-2da3-44c4-aa1e-2a8fca99b707 req-1ab80549-1615-4499-8fbe-07af4625007d service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:48.503113 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-86b718d1-2da3-44c4-aa1e-2a8fca99b707 req-1ab80549-1615-4499-8fbe-07af4625007d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:48.503553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-86b718d1-2da3-44c4-aa1e-2a8fca99b707 req-1ab80549-1615-4499-8fbe-07af4625007d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:48.517545 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-86b718d1-2da3-44c4-aa1e-2a8fca99b707 req-1ab80549-1615-4499-8fbe-07af4625007d service nova] Creating event network-vif-plugged:87b079d0-f5b8-4315-b27a-8988f8c98b86 for instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 on hv-cinder-84052 Aug 24 17:48:48.523205 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-86b718d1-2da3-44c4-aa1e-2a8fca99b707 req-1ab80549-1615-4499-8fbe-07af4625007d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034129 Aug 24 17:48:48.524033 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 51/104] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:48.951889 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f3e2aa50-cfc0-48f9-9a44-6222500d73d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:48.953122 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f3e2aa50-cfc0-48f9-9a44-6222500d73d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:48.962785 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f3e2aa50-cfc0-48f9-9a44-6222500d73d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:48.964211 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f3e2aa50-cfc0-48f9-9a44-6222500d73d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:48.964806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f3e2aa50-cfc0-48f9-9a44-6222500d73d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:48.965715 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f3e2aa50-cfc0-48f9-9a44-6222500d73d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:48.966326 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f3e2aa50-cfc0-48f9-9a44-6222500d73d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:48.967056 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f3e2aa50-cfc0-48f9-9a44-6222500d73d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:49.004182 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d5230680-cc1d-41e5-a48d-b3d316ab7d0d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:49.005032 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d5230680-cc1d-41e5-a48d-b3d316ab7d0d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:49.016298 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d5230680-cc1d-41e5-a48d-b3d316ab7d0d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:49.019669 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d5230680-cc1d-41e5-a48d-b3d316ab7d0d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:49.020372 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d5230680-cc1d-41e5-a48d-b3d316ab7d0d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:49.022482 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d5230680-cc1d-41e5-a48d-b3d316ab7d0d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:49.030143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d5230680-cc1d-41e5-a48d-b3d316ab7d0d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:49.030987 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d5230680-cc1d-41e5-a48d-b3d316ab7d0d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:49.249418 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f3e2aa50-cfc0-48f9-9a44-6222500d73d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:49.260207 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f3e2aa50-cfc0-48f9-9a44-6222500d73d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:49.261904 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f3e2aa50-cfc0-48f9-9a44-6222500d73d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:49.262990 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f3e2aa50-cfc0-48f9-9a44-6222500d73d1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.315120 Aug 24 17:48:49.264464 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 54/105] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:48 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:49.295610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d5230680-cc1d-41e5-a48d-b3d316ab7d0d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:49.303289 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d5230680-cc1d-41e5-a48d-b3d316ab7d0d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.311957 Aug 24 17:48:49.303883 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 52/106] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:48 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:49.462994 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-64ef9aef-a5f3-446e-9769-d86b29e17282 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:49.463632 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-64ef9aef-a5f3-446e-9769-d86b29e17282 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:49.472555 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-64ef9aef-a5f3-446e-9769-d86b29e17282 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:49.473055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-64ef9aef-a5f3-446e-9769-d86b29e17282 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:49.473475 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-64ef9aef-a5f3-446e-9769-d86b29e17282 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:49.474354 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-64ef9aef-a5f3-446e-9769-d86b29e17282 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:49.475014 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-64ef9aef-a5f3-446e-9769-d86b29e17282 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:49.475377 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-64ef9aef-a5f3-446e-9769-d86b29e17282 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:49.699590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-64ef9aef-a5f3-446e-9769-d86b29e17282 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:49.715635 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-64ef9aef-a5f3-446e-9769-d86b29e17282 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.256970 Aug 24 17:48:49.716539 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 55/107] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:49 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:50.289062 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6e43aff4-faba-4806-9c9d-a212ba2e77d9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:50.290876 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6e43aff4-faba-4806-9c9d-a212ba2e77d9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:50.304699 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6e43aff4-faba-4806-9c9d-a212ba2e77d9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:50.305477 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6e43aff4-faba-4806-9c9d-a212ba2e77d9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:50.306301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6e43aff4-faba-4806-9c9d-a212ba2e77d9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:50.307251 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6e43aff4-faba-4806-9c9d-a212ba2e77d9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:50.308012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6e43aff4-faba-4806-9c9d-a212ba2e77d9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:50.308977 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6e43aff4-faba-4806-9c9d-a212ba2e77d9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:50.324827 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3894afef-098c-49d3-a6b6-9a0aacbac3b3 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:50.325445 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3894afef-098c-49d3-a6b6-9a0aacbac3b3 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:50.334013 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3894afef-098c-49d3-a6b6-9a0aacbac3b3 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:50.334754 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3894afef-098c-49d3-a6b6-9a0aacbac3b3 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:50.335348 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3894afef-098c-49d3-a6b6-9a0aacbac3b3 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:50.336765 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3894afef-098c-49d3-a6b6-9a0aacbac3b3 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:50.337379 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3894afef-098c-49d3-a6b6-9a0aacbac3b3 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:50.337947 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3894afef-098c-49d3-a6b6-9a0aacbac3b3 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:50.544327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6e43aff4-faba-4806-9c9d-a212ba2e77d9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:50.556003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6e43aff4-faba-4806-9c9d-a212ba2e77d9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:50.558849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3894afef-098c-49d3-a6b6-9a0aacbac3b3 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:50.562603 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6e43aff4-faba-4806-9c9d-a212ba2e77d9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:50.564840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6e43aff4-faba-4806-9c9d-a212ba2e77d9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.280814 Aug 24 17:48:50.565518 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 53/108] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:50 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:50.580643 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3894afef-098c-49d3-a6b6-9a0aacbac3b3 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.259434 Aug 24 17:48:50.584961 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 56/109] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:50 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:50.743926 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1622384e-9357-40a4-866c-a5add08a4f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:50.747429 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1622384e-9357-40a4-866c-a5add08a4f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:50.756773 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1622384e-9357-40a4-866c-a5add08a4f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:50.757318 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1622384e-9357-40a4-866c-a5add08a4f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:50.758314 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1622384e-9357-40a4-866c-a5add08a4f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:50.759195 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1622384e-9357-40a4-866c-a5add08a4f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:50.759847 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1622384e-9357-40a4-866c-a5add08a4f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:50.762078 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1622384e-9357-40a4-866c-a5add08a4f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:50.972772 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1622384e-9357-40a4-866c-a5add08a4f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:50.982596 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1622384e-9357-40a4-866c-a5add08a4f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.246578 Aug 24 17:48:50.983411 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 54/110] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:50 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:51.137689 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-6137f6e8-7b07-41e3-abf6-680e40c748ec req-8741f117-7233-4478-8283-f3cd594d86cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa644603-71e5-4474-ac86-f0f7ce938d0f", "name": "network-vif-plugged", "status": "completed", "tag": "739a8b43-ab7a-4d3c-b2a6-c214a877b1e1"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:51.155553 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-6137f6e8-7b07-41e3-abf6-680e40c748ec req-8741f117-7233-4478-8283-f3cd594d86cc service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:51.156048 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-6137f6e8-7b07-41e3-abf6-680e40c748ec req-8741f117-7233-4478-8283-f3cd594d86cc service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:51.156479 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-6137f6e8-7b07-41e3-abf6-680e40c748ec req-8741f117-7233-4478-8283-f3cd594d86cc service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:51.186952 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-6137f6e8-7b07-41e3-abf6-680e40c748ec req-8741f117-7233-4478-8283-f3cd594d86cc service nova] Creating event network-vif-plugged:739a8b43-ab7a-4d3c-b2a6-c214a877b1e1 for instance aa644603-71e5-4474-ac86-f0f7ce938d0f on hv-cinder-84052 Aug 24 17:48:51.193696 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-6137f6e8-7b07-41e3-abf6-680e40c748ec req-8741f117-7233-4478-8283-f3cd594d86cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060130 Aug 24 17:48:51.194497 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 57/111] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:48:51.593224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-639fde3a-cb64-49ed-a36c-e5f28fbfd638 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:51.594673 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-639fde3a-cb64-49ed-a36c-e5f28fbfd638 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:51.601099 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-639fde3a-cb64-49ed-a36c-e5f28fbfd638 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:51.602205 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-639fde3a-cb64-49ed-a36c-e5f28fbfd638 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:51.602646 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-639fde3a-cb64-49ed-a36c-e5f28fbfd638 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:51.603349 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-639fde3a-cb64-49ed-a36c-e5f28fbfd638 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:51.603849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-639fde3a-cb64-49ed-a36c-e5f28fbfd638 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:51.604468 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-639fde3a-cb64-49ed-a36c-e5f28fbfd638 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:51.606774 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b38f998e-ea16-46b1-97fb-fe7cd330a37a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:51.607773 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b38f998e-ea16-46b1-97fb-fe7cd330a37a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:51.621236 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b38f998e-ea16-46b1-97fb-fe7cd330a37a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:51.621737 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b38f998e-ea16-46b1-97fb-fe7cd330a37a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:51.622175 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b38f998e-ea16-46b1-97fb-fe7cd330a37a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:51.622891 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b38f998e-ea16-46b1-97fb-fe7cd330a37a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:51.623350 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b38f998e-ea16-46b1-97fb-fe7cd330a37a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:51.623808 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b38f998e-ea16-46b1-97fb-fe7cd330a37a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:51.778316 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-639fde3a-cb64-49ed-a36c-e5f28fbfd638 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:51.788439 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-639fde3a-cb64-49ed-a36c-e5f28fbfd638 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:51.790986 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-639fde3a-cb64-49ed-a36c-e5f28fbfd638 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:51.792760 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-639fde3a-cb64-49ed-a36c-e5f28fbfd638 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.208286 Aug 24 17:48:51.793510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 55/112] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:51 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:51.814781 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b38f998e-ea16-46b1-97fb-fe7cd330a37a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:51.824724 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b38f998e-ea16-46b1-97fb-fe7cd330a37a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.222921 Aug 24 17:48:51.825299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 58/113] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:51 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:52.003215 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-265f7f51-e124-4cd7-a6e1-bceafa0222ac tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:52.003906 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-265f7f51-e124-4cd7-a6e1-bceafa0222ac tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:52.010995 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-265f7f51-e124-4cd7-a6e1-bceafa0222ac tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:52.011549 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-265f7f51-e124-4cd7-a6e1-bceafa0222ac tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:52.012020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-265f7f51-e124-4cd7-a6e1-bceafa0222ac tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:52.012725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-265f7f51-e124-4cd7-a6e1-bceafa0222ac tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:52.013180 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-265f7f51-e124-4cd7-a6e1-bceafa0222ac tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:52.013605 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-265f7f51-e124-4cd7-a6e1-bceafa0222ac tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:52.166682 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-265f7f51-e124-4cd7-a6e1-bceafa0222ac tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:52.174486 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-265f7f51-e124-4cd7-a6e1-bceafa0222ac tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.175407 Aug 24 17:48:52.175038 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 56/114] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:51 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:52.819498 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-bbc157ad-adf7-4506-8ee0-29e42e33b107 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:52.820162 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-bbc157ad-adf7-4506-8ee0-29e42e33b107 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:52.826372 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bbc157ad-adf7-4506-8ee0-29e42e33b107 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:52.826860 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bbc157ad-adf7-4506-8ee0-29e42e33b107 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:52.827293 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bbc157ad-adf7-4506-8ee0-29e42e33b107 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:52.828017 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bbc157ad-adf7-4506-8ee0-29e42e33b107 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:52.828634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bbc157ad-adf7-4506-8ee0-29e42e33b107 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:52.829059 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bbc157ad-adf7-4506-8ee0-29e42e33b107 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:52.845878 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7807b02b-f8ae-4022-a0f4-78a0ea3bac4a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:52.847150 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7807b02b-f8ae-4022-a0f4-78a0ea3bac4a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:52.854507 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7807b02b-f8ae-4022-a0f4-78a0ea3bac4a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:52.856108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7807b02b-f8ae-4022-a0f4-78a0ea3bac4a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:52.856781 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7807b02b-f8ae-4022-a0f4-78a0ea3bac4a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:52.857579 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7807b02b-f8ae-4022-a0f4-78a0ea3bac4a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:52.858133 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7807b02b-f8ae-4022-a0f4-78a0ea3bac4a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:52.858648 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7807b02b-f8ae-4022-a0f4-78a0ea3bac4a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:53.022697 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bbc157ad-adf7-4506-8ee0-29e42e33b107 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:53.033320 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bbc157ad-adf7-4506-8ee0-29e42e33b107 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:53.035425 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bbc157ad-adf7-4506-8ee0-29e42e33b107 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:53.036881 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-bbc157ad-adf7-4506-8ee0-29e42e33b107 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.221229 Aug 24 17:48:53.037713 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 59/115] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:52 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:53.060029 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7807b02b-f8ae-4022-a0f4-78a0ea3bac4a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:53.067991 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7807b02b-f8ae-4022-a0f4-78a0ea3bac4a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.226061 Aug 24 17:48:53.068544 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 57/116] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:52 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:53.198788 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8575c49a-b81f-4fc3-a222-bc3b52b755f7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:53.199407 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8575c49a-b81f-4fc3-a222-bc3b52b755f7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:53.206841 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8575c49a-b81f-4fc3-a222-bc3b52b755f7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:53.207442 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8575c49a-b81f-4fc3-a222-bc3b52b755f7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:53.208247 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8575c49a-b81f-4fc3-a222-bc3b52b755f7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:53.208952 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8575c49a-b81f-4fc3-a222-bc3b52b755f7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:53.209402 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8575c49a-b81f-4fc3-a222-bc3b52b755f7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:53.210090 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8575c49a-b81f-4fc3-a222-bc3b52b755f7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:53.327207 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-7c53c22f-cf81-4b33-8f2e-f7c73f5a8ed6 req-205612a7-d7c1-44e4-8c6b-6361db3505c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11705238-e9d4-4c1e-ab49-d5a27eb4df4c", "name": "network-vif-plugged", "status": "completed", "tag": "41c4ee25-50fb-45d7-9866-1d83514f02d5"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:53.338948 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-7c53c22f-cf81-4b33-8f2e-f7c73f5a8ed6 req-205612a7-d7c1-44e4-8c6b-6361db3505c3 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:53.339930 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-7c53c22f-cf81-4b33-8f2e-f7c73f5a8ed6 req-205612a7-d7c1-44e4-8c6b-6361db3505c3 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:53.340791 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-7c53c22f-cf81-4b33-8f2e-f7c73f5a8ed6 req-205612a7-d7c1-44e4-8c6b-6361db3505c3 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:53.357153 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-7c53c22f-cf81-4b33-8f2e-f7c73f5a8ed6 req-205612a7-d7c1-44e4-8c6b-6361db3505c3 service nova] Creating event network-vif-plugged:41c4ee25-50fb-45d7-9866-1d83514f02d5 for instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c on hv-cinder-84052 Aug 24 17:48:53.364648 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-7c53c22f-cf81-4b33-8f2e-f7c73f5a8ed6 req-205612a7-d7c1-44e4-8c6b-6361db3505c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040641 Aug 24 17:48:53.365550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 58/117] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:48:53.383721 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8575c49a-b81f-4fc3-a222-bc3b52b755f7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:53.407568 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8575c49a-b81f-4fc3-a222-bc3b52b755f7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.216900 Aug 24 17:48:53.408506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 60/118] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:53 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:54.061936 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0caccdb2-a6ef-48c3-90a5-14b23eed4d18 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:54.062627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0caccdb2-a6ef-48c3-90a5-14b23eed4d18 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:54.068989 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0caccdb2-a6ef-48c3-90a5-14b23eed4d18 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:54.069607 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0caccdb2-a6ef-48c3-90a5-14b23eed4d18 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:54.070939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0caccdb2-a6ef-48c3-90a5-14b23eed4d18 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:54.071683 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0caccdb2-a6ef-48c3-90a5-14b23eed4d18 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:54.072141 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0caccdb2-a6ef-48c3-90a5-14b23eed4d18 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:54.072565 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0caccdb2-a6ef-48c3-90a5-14b23eed4d18 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:54.094527 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8c16471b-f7cb-4c56-bdcc-e199780512e4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:54.095159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8c16471b-f7cb-4c56-bdcc-e199780512e4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:54.105509 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8c16471b-f7cb-4c56-bdcc-e199780512e4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:54.106109 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8c16471b-f7cb-4c56-bdcc-e199780512e4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:54.106626 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8c16471b-f7cb-4c56-bdcc-e199780512e4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:54.107405 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8c16471b-f7cb-4c56-bdcc-e199780512e4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:54.107963 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8c16471b-f7cb-4c56-bdcc-e199780512e4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:54.108459 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8c16471b-f7cb-4c56-bdcc-e199780512e4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:54.228457 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0caccdb2-a6ef-48c3-90a5-14b23eed4d18 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:54.240876 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0caccdb2-a6ef-48c3-90a5-14b23eed4d18 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:54.245882 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0caccdb2-a6ef-48c3-90a5-14b23eed4d18 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:54.247464 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0caccdb2-a6ef-48c3-90a5-14b23eed4d18 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.189667 Aug 24 17:48:54.262713 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 59/119] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:54 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:54.263883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8c16471b-f7cb-4c56-bdcc-e199780512e4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:54.272925 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8c16471b-f7cb-4c56-bdcc-e199780512e4 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1314 microversion: 2.1 time: 0.182389 Aug 24 17:48:54.273460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 61/120] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:54 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:54.432011 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-84e5638f-5a9e-4e33-a743-2ad71bf24c9f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:54.432795 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-84e5638f-5a9e-4e33-a743-2ad71bf24c9f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:54.440851 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-84e5638f-5a9e-4e33-a743-2ad71bf24c9f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:54.441413 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-84e5638f-5a9e-4e33-a743-2ad71bf24c9f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:54.441937 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-84e5638f-5a9e-4e33-a743-2ad71bf24c9f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:54.442713 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-84e5638f-5a9e-4e33-a743-2ad71bf24c9f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:54.443157 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-84e5638f-5a9e-4e33-a743-2ad71bf24c9f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:54.451706 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-84e5638f-5a9e-4e33-a743-2ad71bf24c9f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:54.658104 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-84e5638f-5a9e-4e33-a743-2ad71bf24c9f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:54.667294 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-84e5638f-5a9e-4e33-a743-2ad71bf24c9f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.241183 Aug 24 17:48:54.667918 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 60/121] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:54 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:55.269754 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-148c1c49-be50-4c78-8396-9da02688e774 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:55.270464 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-148c1c49-be50-4c78-8396-9da02688e774 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:55.277193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-148c1c49-be50-4c78-8396-9da02688e774 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:55.277754 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-148c1c49-be50-4c78-8396-9da02688e774 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:55.278423 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-148c1c49-be50-4c78-8396-9da02688e774 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:55.279209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-148c1c49-be50-4c78-8396-9da02688e774 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:55.279884 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-148c1c49-be50-4c78-8396-9da02688e774 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:55.280370 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-148c1c49-be50-4c78-8396-9da02688e774 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:55.299613 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-94317d73-af71-4cb7-9705-6c13621d3cdf tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:55.300218 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-94317d73-af71-4cb7-9705-6c13621d3cdf tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:55.306792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-94317d73-af71-4cb7-9705-6c13621d3cdf tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:55.307280 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-94317d73-af71-4cb7-9705-6c13621d3cdf tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:55.307762 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-94317d73-af71-4cb7-9705-6c13621d3cdf tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:55.308593 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-94317d73-af71-4cb7-9705-6c13621d3cdf tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:55.309085 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-94317d73-af71-4cb7-9705-6c13621d3cdf tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:55.309507 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-94317d73-af71-4cb7-9705-6c13621d3cdf tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:55.420209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-148c1c49-be50-4c78-8396-9da02688e774 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:55.428573 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-148c1c49-be50-4c78-8396-9da02688e774 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:55.430521 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-148c1c49-be50-4c78-8396-9da02688e774 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:55.431677 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-148c1c49-be50-4c78-8396-9da02688e774 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.165781 Aug 24 17:48:55.432589 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 62/122] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:55 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:55.611334 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-94317d73-af71-4cb7-9705-6c13621d3cdf tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:55.636089 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-94317d73-af71-4cb7-9705-6c13621d3cdf tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1502 microversion: 2.1 time: 0.343827 Aug 24 17:48:55.636710 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 61/123] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:55 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1502 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:55.688429 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0b899fb0-1197-42f0-ae55-fe6e7e1fa4c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:55.689288 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0b899fb0-1197-42f0-ae55-fe6e7e1fa4c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:55.695660 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0b899fb0-1197-42f0-ae55-fe6e7e1fa4c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:55.696552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0b899fb0-1197-42f0-ae55-fe6e7e1fa4c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:55.697046 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0b899fb0-1197-42f0-ae55-fe6e7e1fa4c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:55.697954 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0b899fb0-1197-42f0-ae55-fe6e7e1fa4c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:55.698463 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0b899fb0-1197-42f0-ae55-fe6e7e1fa4c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:55.699110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0b899fb0-1197-42f0-ae55-fe6e7e1fa4c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:55.870521 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0b899fb0-1197-42f0-ae55-fe6e7e1fa4c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:55.879645 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0b899fb0-1197-42f0-ae55-fe6e7e1fa4c9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.194951 Aug 24 17:48:55.881270 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 63/124] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:55 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:56.455951 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7187dca6-8a57-4220-982b-2670894c4503 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:56.462641 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7187dca6-8a57-4220-982b-2670894c4503 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:56.469816 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7187dca6-8a57-4220-982b-2670894c4503 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:56.470634 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7187dca6-8a57-4220-982b-2670894c4503 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:56.471443 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7187dca6-8a57-4220-982b-2670894c4503 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:56.472437 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7187dca6-8a57-4220-982b-2670894c4503 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:56.472992 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7187dca6-8a57-4220-982b-2670894c4503 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:56.473340 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7187dca6-8a57-4220-982b-2670894c4503 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:56.655575 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7187dca6-8a57-4220-982b-2670894c4503 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:56.667438 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7187dca6-8a57-4220-982b-2670894c4503 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:56.670334 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7187dca6-8a57-4220-982b-2670894c4503 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:56.671520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7187dca6-8a57-4220-982b-2670894c4503 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.221775 Aug 24 17:48:56.672174 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 62/125] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:56 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:48:56.902285 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-556f353b-541c-4cb1-8283-9e53eae81769 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:56.903272 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-556f353b-541c-4cb1-8283-9e53eae81769 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:56.909197 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-556f353b-541c-4cb1-8283-9e53eae81769 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:56.909680 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-556f353b-541c-4cb1-8283-9e53eae81769 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:56.910173 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-556f353b-541c-4cb1-8283-9e53eae81769 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:56.910864 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-556f353b-541c-4cb1-8283-9e53eae81769 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:56.911319 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-556f353b-541c-4cb1-8283-9e53eae81769 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:56.911776 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-556f353b-541c-4cb1-8283-9e53eae81769 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:57.051830 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-556f353b-541c-4cb1-8283-9e53eae81769 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:57.059870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-556f353b-541c-4cb1-8283-9e53eae81769 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.162747 Aug 24 17:48:57.060439 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 64/126] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:56 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:48:57.176535 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-478f7985-d068-422c-b68c-01cbf5e4953d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "706ffd8c-4b33-483a-bb8a-57294f7df822"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:48:57.179016 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-478f7985-d068-422c-b68c-01cbf5e4953d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:57.184934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-478f7985-d068-422c-b68c-01cbf5e4953d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:57.185482 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-478f7985-d068-422c-b68c-01cbf5e4953d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:57.185997 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-478f7985-d068-422c-b68c-01cbf5e4953d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:57.186741 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-478f7985-d068-422c-b68c-01cbf5e4953d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:57.187254 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-478f7985-d068-422c-b68c-01cbf5e4953d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:57.187830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-478f7985-d068-422c-b68c-01cbf5e4953d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:57.697161 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-bc7c05d3-f6d2-439e-9a10-3648f81e4e57 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:57.698050 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-bc7c05d3-f6d2-439e-9a10-3648f81e4e57 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:57.708308 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bc7c05d3-f6d2-439e-9a10-3648f81e4e57 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:57.709106 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bc7c05d3-f6d2-439e-9a10-3648f81e4e57 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:57.709767 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bc7c05d3-f6d2-439e-9a10-3648f81e4e57 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:57.710912 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bc7c05d3-f6d2-439e-9a10-3648f81e4e57 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:57.711590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bc7c05d3-f6d2-439e-9a10-3648f81e4e57 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:57.712290 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bc7c05d3-f6d2-439e-9a10-3648f81e4e57 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:57.883948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bc7c05d3-f6d2-439e-9a10-3648f81e4e57 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:57.888644 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=100 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:48:57.894463 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bc7c05d3-f6d2-439e-9a10-3648f81e4e57 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:57.896335 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bc7c05d3-f6d2-439e-9a10-3648f81e4e57 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:57.897524 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-bc7c05d3-f6d2-439e-9a10-3648f81e4e57 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.206976 Aug 24 17:48:57.898297 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 65/127] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:57 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:48:58.080964 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-bda01e27-32f8-4057-a5e3-eaa2d96ef788 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:58.081633 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-bda01e27-32f8-4057-a5e3-eaa2d96ef788 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:58.088561 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bda01e27-32f8-4057-a5e3-eaa2d96ef788 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:58.089262 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bda01e27-32f8-4057-a5e3-eaa2d96ef788 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:58.089826 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bda01e27-32f8-4057-a5e3-eaa2d96ef788 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:58.090486 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bda01e27-32f8-4057-a5e3-eaa2d96ef788 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:58.090963 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bda01e27-32f8-4057-a5e3-eaa2d96ef788 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:58.091386 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bda01e27-32f8-4057-a5e3-eaa2d96ef788 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:58.232222 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bda01e27-32f8-4057-a5e3-eaa2d96ef788 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:58.240847 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-bda01e27-32f8-4057-a5e3-eaa2d96ef788 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.164077 Aug 24 17:48:58.241436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 66/128] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:58 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:48:58.920819 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3091e69c-ef4a-4744-bbca-af231af60f35 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:58.921357 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3091e69c-ef4a-4744-bbca-af231af60f35 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:58.927310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3091e69c-ef4a-4744-bbca-af231af60f35 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:58.927822 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3091e69c-ef4a-4744-bbca-af231af60f35 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:58.928253 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3091e69c-ef4a-4744-bbca-af231af60f35 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:58.928930 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3091e69c-ef4a-4744-bbca-af231af60f35 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:58.930019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3091e69c-ef4a-4744-bbca-af231af60f35 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:58.930440 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3091e69c-ef4a-4744-bbca-af231af60f35 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:59.056100 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3091e69c-ef4a-4744-bbca-af231af60f35 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:59.064397 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3091e69c-ef4a-4744-bbca-af231af60f35 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:59.065931 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3091e69c-ef4a-4744-bbca-af231af60f35 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:59.067024 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3091e69c-ef4a-4744-bbca-af231af60f35 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.150175 Aug 24 17:48:59.067588 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 67/129] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:48:58 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:48:59.262519 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3271cecf-92b3-4163-9630-be63fde6040c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:48:59.263147 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3271cecf-92b3-4163-9630-be63fde6040c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:48:59.269009 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3271cecf-92b3-4163-9630-be63fde6040c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:59.269486 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3271cecf-92b3-4163-9630-be63fde6040c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:59.269917 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3271cecf-92b3-4163-9630-be63fde6040c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:59.270595 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3271cecf-92b3-4163-9630-be63fde6040c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:48:59.271045 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3271cecf-92b3-4163-9630-be63fde6040c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:48:59.271460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3271cecf-92b3-4163-9630-be63fde6040c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:48:59.399611 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3271cecf-92b3-4163-9630-be63fde6040c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:48:59.407392 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3271cecf-92b3-4163-9630-be63fde6040c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.148582 Aug 24 17:48:59.407979 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 68/130] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:48:59 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:00.090430 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d881836c-7e44-4473-ac73-58dad96a1f9a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:00.090962 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d881836c-7e44-4473-ac73-58dad96a1f9a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:00.097101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d881836c-7e44-4473-ac73-58dad96a1f9a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:00.097582 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d881836c-7e44-4473-ac73-58dad96a1f9a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:00.098014 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d881836c-7e44-4473-ac73-58dad96a1f9a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:00.098696 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d881836c-7e44-4473-ac73-58dad96a1f9a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:00.099145 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d881836c-7e44-4473-ac73-58dad96a1f9a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:00.099590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d881836c-7e44-4473-ac73-58dad96a1f9a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:00.224627 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d881836c-7e44-4473-ac73-58dad96a1f9a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:00.233241 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d881836c-7e44-4473-ac73-58dad96a1f9a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:00.234742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d881836c-7e44-4473-ac73-58dad96a1f9a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:00.235987 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d881836c-7e44-4473-ac73-58dad96a1f9a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1407 microversion: 2.20 time: 0.149512 Aug 24 17:49:00.236535 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 69/131] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:00 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:49:00.428104 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d252203c-1ca2-4417-a269-799a96c4a7e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:00.428728 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d252203c-1ca2-4417-a269-799a96c4a7e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:00.434510 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d252203c-1ca2-4417-a269-799a96c4a7e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:00.434991 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d252203c-1ca2-4417-a269-799a96c4a7e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:00.435422 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d252203c-1ca2-4417-a269-799a96c4a7e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:00.436132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d252203c-1ca2-4417-a269-799a96c4a7e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:00.436586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d252203c-1ca2-4417-a269-799a96c4a7e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:00.437004 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d252203c-1ca2-4417-a269-799a96c4a7e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:00.571128 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d252203c-1ca2-4417-a269-799a96c4a7e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:00.579367 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d252203c-1ca2-4417-a269-799a96c4a7e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1321 microversion: 2.1 time: 0.155194 Aug 24 17:49:00.579961 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 70/132] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:00 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:01.259942 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-371eee89-aee2-416f-9dd3-a2af066a7706 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:01.260545 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-371eee89-aee2-416f-9dd3-a2af066a7706 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:01.266590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-371eee89-aee2-416f-9dd3-a2af066a7706 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:01.267070 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-371eee89-aee2-416f-9dd3-a2af066a7706 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:01.267515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-371eee89-aee2-416f-9dd3-a2af066a7706 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:01.268209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-371eee89-aee2-416f-9dd3-a2af066a7706 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:01.268651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-371eee89-aee2-416f-9dd3-a2af066a7706 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:01.269062 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-371eee89-aee2-416f-9dd3-a2af066a7706 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:01.401597 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-371eee89-aee2-416f-9dd3-a2af066a7706 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:01.410108 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-371eee89-aee2-416f-9dd3-a2af066a7706 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:01.411770 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-371eee89-aee2-416f-9dd3-a2af066a7706 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:01.412959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-371eee89-aee2-416f-9dd3-a2af066a7706 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1599 microversion: 2.20 time: 0.157180 Aug 24 17:49:01.413513 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 71/133] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:49:01 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:49:01.434934 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-28cf4305-e9ab-418e-9f1f-98fec175a1cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:01.435516 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-28cf4305-e9ab-418e-9f1f-98fec175a1cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:01.441237 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-28cf4305-e9ab-418e-9f1f-98fec175a1cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:01.441715 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-28cf4305-e9ab-418e-9f1f-98fec175a1cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:01.442140 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-28cf4305-e9ab-418e-9f1f-98fec175a1cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:01.442838 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-28cf4305-e9ab-418e-9f1f-98fec175a1cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:01.443271 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-28cf4305-e9ab-418e-9f1f-98fec175a1cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:01.443718 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-28cf4305-e9ab-418e-9f1f-98fec175a1cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:01.583994 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-28cf4305-e9ab-418e-9f1f-98fec175a1cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.152578 Aug 24 17:49:01.584808 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 72/134] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Aug 24 17:49:01 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:49:01.601418 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-340416e7-3926-4553-9321-8d061089fddc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:01.602379 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-340416e7-3926-4553-9321-8d061089fddc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:01.612489 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-340416e7-3926-4553-9321-8d061089fddc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:01.615511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-340416e7-3926-4553-9321-8d061089fddc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:01.616294 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-340416e7-3926-4553-9321-8d061089fddc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:01.617752 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-340416e7-3926-4553-9321-8d061089fddc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:01.619005 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-340416e7-3926-4553-9321-8d061089fddc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:01.619728 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-340416e7-3926-4553-9321-8d061089fddc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:01.841078 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:01.861458 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-340416e7-3926-4553-9321-8d061089fddc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:01.870171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-478f7985-d068-422c-b68c-01cbf5e4953d tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "POST /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.697420 Aug 24 17:49:01.880540 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 63/135] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:48:57 2022] POST /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb/os-volume_attachments => generated 194 bytes in 4700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:49:01.884237 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-340416e7-3926-4553-9321-8d061089fddc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1514 microversion: 2.1 time: 0.287122 Aug 24 17:49:01.893264 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 73/136] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:01 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1514 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:01.906640 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-de1b6d04-6212-4c40-b50b-0089804df100 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:01.909805 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-de1b6d04-6212-4c40-b50b-0089804df100 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:01.917191 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de1b6d04-6212-4c40-b50b-0089804df100 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:01.917677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de1b6d04-6212-4c40-b50b-0089804df100 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:01.918846 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de1b6d04-6212-4c40-b50b-0089804df100 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:01.919685 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de1b6d04-6212-4c40-b50b-0089804df100 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:01.920322 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de1b6d04-6212-4c40-b50b-0089804df100 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:01.921094 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de1b6d04-6212-4c40-b50b-0089804df100 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:01.957443 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-de1b6d04-6212-4c40-b50b-0089804df100 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lazy-loading 'flavor' on Instance uuid aa644603-71e5-4474-ac86-f0f7ce938d0f {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:49:02.137125 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-de1b6d04-6212-4c40-b50b-0089804df100 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "POST /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f/action" status: 200 len: 32 microversion: 2.1 time: 0.231907 Aug 24 17:49:02.137883 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 64/137] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:49:01 2022] POST /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f/action => generated 32 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 17:49:02.156841 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b739d52e-d29c-44f8-b67e-45509f5c3f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:02.157769 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b739d52e-d29c-44f8-b67e-45509f5c3f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:02.179319 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b739d52e-d29c-44f8-b67e-45509f5c3f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:02.179319 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b739d52e-d29c-44f8-b67e-45509f5c3f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:02.179319 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b739d52e-d29c-44f8-b67e-45509f5c3f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:02.179319 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b739d52e-d29c-44f8-b67e-45509f5c3f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:02.179668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b739d52e-d29c-44f8-b67e-45509f5c3f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:02.179668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b739d52e-d29c-44f8-b67e-45509f5c3f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:02.370403 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b739d52e-d29c-44f8-b67e-45509f5c3f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:02.382284 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b739d52e-d29c-44f8-b67e-45509f5c3f9b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.238475 Aug 24 17:49:02.387692 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 74/138] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:02 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:03.411775 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-425040be-b3c3-4c4a-9a93-b67c5333ed3a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:03.412466 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-425040be-b3c3-4c4a-9a93-b67c5333ed3a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:03.420188 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-425040be-b3c3-4c4a-9a93-b67c5333ed3a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:03.420837 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-425040be-b3c3-4c4a-9a93-b67c5333ed3a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:03.421587 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-425040be-b3c3-4c4a-9a93-b67c5333ed3a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:03.422622 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-425040be-b3c3-4c4a-9a93-b67c5333ed3a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:03.423926 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-425040be-b3c3-4c4a-9a93-b67c5333ed3a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:03.424417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-425040be-b3c3-4c4a-9a93-b67c5333ed3a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:04.009990 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-425040be-b3c3-4c4a-9a93-b67c5333ed3a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:04.022285 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-425040be-b3c3-4c4a-9a93-b67c5333ed3a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.614001 Aug 24 17:49:04.024276 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 65/139] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:03 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:04.284031 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-2a9240fd-1f77-4731-89f4-09faa6eebea3 req-fdc881ab-75b7-4321-8efc-fbe9a5e6779d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11705238-e9d4-4c1e-ab49-d5a27eb4df4c", "tag": "41c4ee25-50fb-45d7-9866-1d83514f02d5"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:04.294968 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-2a9240fd-1f77-4731-89f4-09faa6eebea3 req-fdc881ab-75b7-4321-8efc-fbe9a5e6779d service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:04.295869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-2a9240fd-1f77-4731-89f4-09faa6eebea3 req-fdc881ab-75b7-4321-8efc-fbe9a5e6779d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:04.296506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-2a9240fd-1f77-4731-89f4-09faa6eebea3 req-fdc881ab-75b7-4321-8efc-fbe9a5e6779d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:04.312622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-2a9240fd-1f77-4731-89f4-09faa6eebea3 req-fdc881ab-75b7-4321-8efc-fbe9a5e6779d service nova] Creating event network-changed:41c4ee25-50fb-45d7-9866-1d83514f02d5 for instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c on hv-cinder-84052 Aug 24 17:49:04.321222 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-2a9240fd-1f77-4731-89f4-09faa6eebea3 req-fdc881ab-75b7-4321-8efc-fbe9a5e6779d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040322 Aug 24 17:49:04.322179 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 75/140] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:05.051333 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6ec367ad-018e-46f5-8d46-cc307522df9e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:05.057339 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6ec367ad-018e-46f5-8d46-cc307522df9e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:05.064112 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6ec367ad-018e-46f5-8d46-cc307522df9e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:05.065097 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6ec367ad-018e-46f5-8d46-cc307522df9e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:05.065705 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6ec367ad-018e-46f5-8d46-cc307522df9e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:05.066603 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6ec367ad-018e-46f5-8d46-cc307522df9e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:05.067228 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6ec367ad-018e-46f5-8d46-cc307522df9e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:05.067959 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6ec367ad-018e-46f5-8d46-cc307522df9e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:05.424609 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6ec367ad-018e-46f5-8d46-cc307522df9e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:05.433884 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6ec367ad-018e-46f5-8d46-cc307522df9e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.391677 Aug 24 17:49:05.434847 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 66/141] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:05 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:06.468292 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-11a320c8-b48d-48b2-9122-5c6e3a4d628a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:06.471933 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-11a320c8-b48d-48b2-9122-5c6e3a4d628a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:06.487640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=79 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:06.504490 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-11a320c8-b48d-48b2-9122-5c6e3a4d628a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:06.505626 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-11a320c8-b48d-48b2-9122-5c6e3a4d628a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:06.506535 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-11a320c8-b48d-48b2-9122-5c6e3a4d628a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:06.509708 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-11a320c8-b48d-48b2-9122-5c6e3a4d628a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:06.516436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-11a320c8-b48d-48b2-9122-5c6e3a4d628a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:06.519621 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-11a320c8-b48d-48b2-9122-5c6e3a4d628a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:06.714515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-11a320c8-b48d-48b2-9122-5c6e3a4d628a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:06.725158 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-11a320c8-b48d-48b2-9122-5c6e3a4d628a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.272477 Aug 24 17:49:06.726959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 76/142] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:06 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:07.752905 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7ea346f0-e338-45bc-98fa-33137ed0f506 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:07.753535 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7ea346f0-e338-45bc-98fa-33137ed0f506 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:07.755984 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=64 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:07.763316 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ea346f0-e338-45bc-98fa-33137ed0f506 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:07.763941 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ea346f0-e338-45bc-98fa-33137ed0f506 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:07.764627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ea346f0-e338-45bc-98fa-33137ed0f506 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:07.765428 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ea346f0-e338-45bc-98fa-33137ed0f506 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:07.765887 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ea346f0-e338-45bc-98fa-33137ed0f506 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:07.766493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ea346f0-e338-45bc-98fa-33137ed0f506 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:07.902837 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7ea346f0-e338-45bc-98fa-33137ed0f506 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:07.915661 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7ea346f0-e338-45bc-98fa-33137ed0f506 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.166554 Aug 24 17:49:07.916213 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 67/143] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:07 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:08.937729 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-adf4aa75-d1a3-4ed0-8001-13469d7c5770 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:08.938294 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-adf4aa75-d1a3-4ed0-8001-13469d7c5770 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:08.950380 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-adf4aa75-d1a3-4ed0-8001-13469d7c5770 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:08.950877 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-adf4aa75-d1a3-4ed0-8001-13469d7c5770 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:08.951314 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-adf4aa75-d1a3-4ed0-8001-13469d7c5770 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:08.952401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-adf4aa75-d1a3-4ed0-8001-13469d7c5770 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:08.953009 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-adf4aa75-d1a3-4ed0-8001-13469d7c5770 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:08.953644 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-adf4aa75-d1a3-4ed0-8001-13469d7c5770 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:09.139112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-adf4aa75-d1a3-4ed0-8001-13469d7c5770 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:09.147231 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-adf4aa75-d1a3-4ed0-8001-13469d7c5770 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.213881 Aug 24 17:49:09.168663 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 77/144] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:08 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:10.180164 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a951e482-0ec4-424a-9152-53b2156bdec1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:10.180781 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a951e482-0ec4-424a-9152-53b2156bdec1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:10.187753 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a951e482-0ec4-424a-9152-53b2156bdec1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:10.188477 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a951e482-0ec4-424a-9152-53b2156bdec1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:10.189656 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a951e482-0ec4-424a-9152-53b2156bdec1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:10.190505 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a951e482-0ec4-424a-9152-53b2156bdec1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:10.191041 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a951e482-0ec4-424a-9152-53b2156bdec1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:10.191561 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a951e482-0ec4-424a-9152-53b2156bdec1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:10.337029 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a951e482-0ec4-424a-9152-53b2156bdec1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:10.345019 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a951e482-0ec4-424a-9152-53b2156bdec1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.170100 Aug 24 17:49:10.345589 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 68/145] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:10 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:11.366025 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8738739d-5750-410b-9d44-5d355f4431ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:11.366661 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8738739d-5750-410b-9d44-5d355f4431ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:11.373285 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8738739d-5750-410b-9d44-5d355f4431ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:11.374189 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8738739d-5750-410b-9d44-5d355f4431ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:11.374524 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8738739d-5750-410b-9d44-5d355f4431ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:11.375261 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8738739d-5750-410b-9d44-5d355f4431ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:11.375741 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8738739d-5750-410b-9d44-5d355f4431ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:11.376276 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8738739d-5750-410b-9d44-5d355f4431ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:11.513010 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8738739d-5750-410b-9d44-5d355f4431ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:11.520639 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8738739d-5750-410b-9d44-5d355f4431ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.158537 Aug 24 17:49:11.521202 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 78/146] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:11 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:12.541892 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-402b1d03-fe2b-490a-8edd-e24aab1b4c27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:12.542510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-402b1d03-fe2b-490a-8edd-e24aab1b4c27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:12.548611 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-402b1d03-fe2b-490a-8edd-e24aab1b4c27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:12.549071 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-402b1d03-fe2b-490a-8edd-e24aab1b4c27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:12.549502 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-402b1d03-fe2b-490a-8edd-e24aab1b4c27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:12.550217 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-402b1d03-fe2b-490a-8edd-e24aab1b4c27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:12.550666 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-402b1d03-fe2b-490a-8edd-e24aab1b4c27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:12.551085 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-402b1d03-fe2b-490a-8edd-e24aab1b4c27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:12.689853 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-402b1d03-fe2b-490a-8edd-e24aab1b4c27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:12.697663 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-402b1d03-fe2b-490a-8edd-e24aab1b4c27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.159486 Aug 24 17:49:12.698220 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 69/147] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:12 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:13.493080 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-806624066", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "networks": [{"uuid": "36e38d0d-5ac8-4cf5-ac87-8b158b40ef79"}]}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:13.581800 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.network.neutron [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] validate_networks() for [('36e38d0d-5ac8-4cf5-ac87-8b158b40ef79', None, None, None, None, None)] {{(pid=126994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:49:13.724681 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9d37d299-fb08-45fa-9254-9414a10b82fa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:13.724681 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9d37d299-fb08-45fa-9254-9414a10b82fa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:13.732622 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9d37d299-fb08-45fa-9254-9414a10b82fa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:13.733181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9d37d299-fb08-45fa-9254-9414a10b82fa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:13.733679 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9d37d299-fb08-45fa-9254-9414a10b82fa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:13.734450 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9d37d299-fb08-45fa-9254-9414a10b82fa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:13.735334 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9d37d299-fb08-45fa-9254-9414a10b82fa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:13.748262 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9d37d299-fb08-45fa-9254-9414a10b82fa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:13.927943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9d37d299-fb08-45fa-9254-9414a10b82fa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:13.945929 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9d37d299-fb08-45fa-9254-9414a10b82fa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.228568 Aug 24 17:49:13.947506 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 70/148] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:13 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:14.041991 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Flavor limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:49:14.042727 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Image limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:49:14.043705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Flavor pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:49:14.044504 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Image pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:49:14.045229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:49:14.055133 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:14.055637 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:14.056236 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:14.057100 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:14.057715 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:14.058295 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:14.070966 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9799581e-8e24-4300-9d87-303fb1ad5c0e tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:14.071470 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9799581e-8e24-4300-9d87-303fb1ad5c0e tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:14.078475 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9799581e-8e24-4300-9d87-303fb1ad5c0e tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:14.078968 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9799581e-8e24-4300-9d87-303fb1ad5c0e tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:14.079460 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9799581e-8e24-4300-9d87-303fb1ad5c0e tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:14.079716 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Getting quotas for project f62f652ab66a4289be10048e1c8169d6. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:49:14.080276 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9799581e-8e24-4300-9d87-303fb1ad5c0e tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:14.080688 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9799581e-8e24-4300-9d87-303fb1ad5c0e tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:14.081078 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9799581e-8e24-4300-9d87-303fb1ad5c0e tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:14.086986 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Getting quotas for user 4aa761298e1f45e08fe4e42fba210d2b and project f62f652ab66a4289be10048e1c8169d6. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:49:14.099506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Going to run 1 instances... {{(pid=126994) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:49:14.103999 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:49:14.111709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9799581e-8e24-4300-9d87-303fb1ad5c0e tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:49:14.170181 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-860e7f71-b070-486e-854b-b4bf28360b05 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682811 Aug 24 17:49:14.176671 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 79/149] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:49:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:49:14.181600 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9a31618d-45e5-48e3-9e3e-cb3dd0126e5d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:14.182506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9a31618d-45e5-48e3-9e3e-cb3dd0126e5d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:14.237458 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9799581e-8e24-4300-9d87-303fb1ad5c0e tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 204 len: 0 microversion: 2.1 time: 0.170405 Aug 24 17:49:14.238151 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 71/150] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:49:14 2022] DELETE /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:49:14.248219 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3800d805-2464-4767-b3eb-14ad19e981ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:14.249255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3800d805-2464-4767-b3eb-14ad19e981ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:14.251833 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9a31618d-45e5-48e3-9e3e-cb3dd0126e5d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:14.257066 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3800d805-2464-4767-b3eb-14ad19e981ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:14.258325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3800d805-2464-4767-b3eb-14ad19e981ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:14.258860 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3800d805-2464-4767-b3eb-14ad19e981ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:14.259753 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3800d805-2464-4767-b3eb-14ad19e981ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:14.260303 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3800d805-2464-4767-b3eb-14ad19e981ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:14.260962 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3800d805-2464-4767-b3eb-14ad19e981ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:14.262172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9a31618d-45e5-48e3-9e3e-cb3dd0126e5d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1213 microversion: 2.1 time: 0.084396 Aug 24 17:49:14.263299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 80/151] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:14 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:14.429657 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-3800d805-2464-4767-b3eb-14ad19e981ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:14.438561 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-3800d805-2464-4767-b3eb-14ad19e981ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1554 microversion: 2.1 time: 0.195253 Aug 24 17:49:14.439175 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 72/152] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:14 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:14.970499 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d65cd84f-36b8-40e4-9608-45cb8c9aa98b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:14.971132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d65cd84f-36b8-40e4-9608-45cb8c9aa98b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:14.977273 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d65cd84f-36b8-40e4-9608-45cb8c9aa98b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:14.977753 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d65cd84f-36b8-40e4-9608-45cb8c9aa98b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:14.978182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d65cd84f-36b8-40e4-9608-45cb8c9aa98b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:14.978865 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d65cd84f-36b8-40e4-9608-45cb8c9aa98b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:14.979312 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d65cd84f-36b8-40e4-9608-45cb8c9aa98b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:14.979757 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d65cd84f-36b8-40e4-9608-45cb8c9aa98b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:15.121073 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d65cd84f-36b8-40e4-9608-45cb8c9aa98b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:15.128842 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d65cd84f-36b8-40e4-9608-45cb8c9aa98b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.162456 Aug 24 17:49:15.129399 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 81/153] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:14 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:15.285916 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b9e4350d-2ce5-4926-873f-9b47cb8d25f6 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:15.286566 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b9e4350d-2ce5-4926-873f-9b47cb8d25f6 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:15.294407 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b9e4350d-2ce5-4926-873f-9b47cb8d25f6 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:15.294893 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b9e4350d-2ce5-4926-873f-9b47cb8d25f6 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:15.295315 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b9e4350d-2ce5-4926-873f-9b47cb8d25f6 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:15.296034 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b9e4350d-2ce5-4926-873f-9b47cb8d25f6 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:15.296480 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b9e4350d-2ce5-4926-873f-9b47cb8d25f6 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:15.296897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b9e4350d-2ce5-4926-873f-9b47cb8d25f6 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:15.361667 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b9e4350d-2ce5-4926-873f-9b47cb8d25f6 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:15.370777 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b9e4350d-2ce5-4926-873f-9b47cb8d25f6 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1217 microversion: 2.1 time: 0.088883 Aug 24 17:49:15.371342 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 73/154] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:15 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:15.462205 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b02139aa-3bfb-4c99-b1fe-72f1a6ce4b9b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:15.462717 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b02139aa-3bfb-4c99-b1fe-72f1a6ce4b9b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:15.469258 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b02139aa-3bfb-4c99-b1fe-72f1a6ce4b9b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:15.469735 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b02139aa-3bfb-4c99-b1fe-72f1a6ce4b9b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:15.470158 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b02139aa-3bfb-4c99-b1fe-72f1a6ce4b9b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:15.470837 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b02139aa-3bfb-4c99-b1fe-72f1a6ce4b9b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:15.471332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b02139aa-3bfb-4c99-b1fe-72f1a6ce4b9b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:15.471718 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b02139aa-3bfb-4c99-b1fe-72f1a6ce4b9b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:15.622532 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b02139aa-3bfb-4c99-b1fe-72f1a6ce4b9b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:15.640839 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b02139aa-3bfb-4c99-b1fe-72f1a6ce4b9b tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1554 microversion: 2.1 time: 0.182341 Aug 24 17:49:15.641924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 82/155] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:15 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:16.150927 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1ce6de1b-64ba-4859-8a7e-14c4e96f9607 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:16.151598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1ce6de1b-64ba-4859-8a7e-14c4e96f9607 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:16.157604 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ce6de1b-64ba-4859-8a7e-14c4e96f9607 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:16.158396 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ce6de1b-64ba-4859-8a7e-14c4e96f9607 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:16.159029 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ce6de1b-64ba-4859-8a7e-14c4e96f9607 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:16.159868 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ce6de1b-64ba-4859-8a7e-14c4e96f9607 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:16.160422 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ce6de1b-64ba-4859-8a7e-14c4e96f9607 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:16.161116 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ce6de1b-64ba-4859-8a7e-14c4e96f9607 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:16.308503 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1ce6de1b-64ba-4859-8a7e-14c4e96f9607 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:16.323352 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1ce6de1b-64ba-4859-8a7e-14c4e96f9607 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.176786 Aug 24 17:49:16.326191 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 74/156] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:16 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:16.390746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3cc71903-c65d-4628-85a1-a7c0a847bdf9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:16.391520 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3cc71903-c65d-4628-85a1-a7c0a847bdf9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:16.397883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3cc71903-c65d-4628-85a1-a7c0a847bdf9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:16.398568 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3cc71903-c65d-4628-85a1-a7c0a847bdf9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:16.399003 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3cc71903-c65d-4628-85a1-a7c0a847bdf9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:16.399721 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3cc71903-c65d-4628-85a1-a7c0a847bdf9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:16.400177 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3cc71903-c65d-4628-85a1-a7c0a847bdf9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:16.400775 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3cc71903-c65d-4628-85a1-a7c0a847bdf9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:16.478010 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3cc71903-c65d-4628-85a1-a7c0a847bdf9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:16.486011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3cc71903-c65d-4628-85a1-a7c0a847bdf9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1209 microversion: 2.1 time: 0.099218 Aug 24 17:49:16.486823 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 83/157] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:16 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:16.665028 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ba0fb30d-120a-4b4a-8ea2-e2f0bd8f7b97 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:16.665642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ba0fb30d-120a-4b4a-8ea2-e2f0bd8f7b97 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:16.671789 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba0fb30d-120a-4b4a-8ea2-e2f0bd8f7b97 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:16.672273 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba0fb30d-120a-4b4a-8ea2-e2f0bd8f7b97 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:16.672701 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba0fb30d-120a-4b4a-8ea2-e2f0bd8f7b97 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:16.673510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba0fb30d-120a-4b4a-8ea2-e2f0bd8f7b97 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:16.673829 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba0fb30d-120a-4b4a-8ea2-e2f0bd8f7b97 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:16.674247 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba0fb30d-120a-4b4a-8ea2-e2f0bd8f7b97 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:16.836928 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ba0fb30d-120a-4b4a-8ea2-e2f0bd8f7b97 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:16.846385 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ba0fb30d-120a-4b4a-8ea2-e2f0bd8f7b97 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1554 microversion: 2.1 time: 0.185594 Aug 24 17:49:16.847368 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 75/158] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:16 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:17.350756 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e3ae39a6-f1d4-4db9-8007-34a4e2f0d774 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:17.352585 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e3ae39a6-f1d4-4db9-8007-34a4e2f0d774 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:17.361887 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e3ae39a6-f1d4-4db9-8007-34a4e2f0d774 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:17.362883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e3ae39a6-f1d4-4db9-8007-34a4e2f0d774 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:17.363842 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e3ae39a6-f1d4-4db9-8007-34a4e2f0d774 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:17.364828 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e3ae39a6-f1d4-4db9-8007-34a4e2f0d774 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:17.365602 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e3ae39a6-f1d4-4db9-8007-34a4e2f0d774 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:17.366676 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e3ae39a6-f1d4-4db9-8007-34a4e2f0d774 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:17.510062 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f3336e8b-de90-4e9d-9a41-122cb6bebcd3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:17.510683 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f3336e8b-de90-4e9d-9a41-122cb6bebcd3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:17.525908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f3336e8b-de90-4e9d-9a41-122cb6bebcd3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:17.526416 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f3336e8b-de90-4e9d-9a41-122cb6bebcd3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:17.527001 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f3336e8b-de90-4e9d-9a41-122cb6bebcd3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:17.527591 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f3336e8b-de90-4e9d-9a41-122cb6bebcd3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:17.528054 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f3336e8b-de90-4e9d-9a41-122cb6bebcd3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:17.528483 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f3336e8b-de90-4e9d-9a41-122cb6bebcd3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:17.531835 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e3ae39a6-f1d4-4db9-8007-34a4e2f0d774 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:17.545476 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e3ae39a6-f1d4-4db9-8007-34a4e2f0d774 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.200513 Aug 24 17:49:17.552091 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 84/159] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:17 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:17.642714 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f3336e8b-de90-4e9d-9a41-122cb6bebcd3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:17.647530 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:17.655965 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-f3336e8b-de90-4e9d-9a41-122cb6bebcd3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1271 microversion: 2.1 time: 0.149999 Aug 24 17:49:17.668941 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 76/160] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:17 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:17.871834 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f8daa162-29ed-4da5-be2f-20bbbb7cc043 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:17.872570 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f8daa162-29ed-4da5-be2f-20bbbb7cc043 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:17.880080 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f8daa162-29ed-4da5-be2f-20bbbb7cc043 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:17.881098 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f8daa162-29ed-4da5-be2f-20bbbb7cc043 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:17.881718 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f8daa162-29ed-4da5-be2f-20bbbb7cc043 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:17.883167 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f8daa162-29ed-4da5-be2f-20bbbb7cc043 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:17.884301 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f8daa162-29ed-4da5-be2f-20bbbb7cc043 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:17.884881 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f8daa162-29ed-4da5-be2f-20bbbb7cc043 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:17.902381 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=100 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:18.135745 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f8daa162-29ed-4da5-be2f-20bbbb7cc043 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:18.146137 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f8daa162-29ed-4da5-be2f-20bbbb7cc043 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1554 microversion: 2.1 time: 0.280484 Aug 24 17:49:18.162318 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 85/161] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:17 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1554 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:18.561564 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-e8ccc0b6-e1f8-40d0-a1b6-c73737283883 req-0b068778-fe82-4fa0-992a-a527da6f2fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca739a9-de86-4fb2-b047-7bc75fa540bb", "name": "network-vif-deleted", "tag": "8a5ff39c-8fa9-4c77-85a2-b39dce880069"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:18.572533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9d96f66e-14a3-4fe4-bdc8-4d5b8e51402e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:18.575448 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9d96f66e-14a3-4fe4-bdc8-4d5b8e51402e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:18.581962 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-e8ccc0b6-e1f8-40d0-a1b6-c73737283883 req-0b068778-fe82-4fa0-992a-a527da6f2fff service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:18.582770 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-e8ccc0b6-e1f8-40d0-a1b6-c73737283883 req-0b068778-fe82-4fa0-992a-a527da6f2fff service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:18.583430 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-e8ccc0b6-e1f8-40d0-a1b6-c73737283883 req-0b068778-fe82-4fa0-992a-a527da6f2fff service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:18.596174 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9d96f66e-14a3-4fe4-bdc8-4d5b8e51402e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:18.597055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9d96f66e-14a3-4fe4-bdc8-4d5b8e51402e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:18.597798 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9d96f66e-14a3-4fe4-bdc8-4d5b8e51402e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:18.598736 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9d96f66e-14a3-4fe4-bdc8-4d5b8e51402e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:18.609745 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9d96f66e-14a3-4fe4-bdc8-4d5b8e51402e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:18.611954 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9d96f66e-14a3-4fe4-bdc8-4d5b8e51402e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:18.615607 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-e8ccc0b6-e1f8-40d0-a1b6-c73737283883 req-0b068778-fe82-4fa0-992a-a527da6f2fff service nova] Creating event network-vif-deleted:8a5ff39c-8fa9-4c77-85a2-b39dce880069 for instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb on hv-cinder-84052 Aug 24 17:49:18.646826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-e8ccc0b6-e1f8-40d0-a1b6-c73737283883 req-0b068778-fe82-4fa0-992a-a527da6f2fff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091570 Aug 24 17:49:18.647630 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 77/162] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:18.678727 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6fc57085-c2a8-460e-a2ed-7b2c7a5c6908 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:18.679999 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6fc57085-c2a8-460e-a2ed-7b2c7a5c6908 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:18.690060 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6fc57085-c2a8-460e-a2ed-7b2c7a5c6908 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:18.690768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6fc57085-c2a8-460e-a2ed-7b2c7a5c6908 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:18.691205 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6fc57085-c2a8-460e-a2ed-7b2c7a5c6908 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:18.691949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6fc57085-c2a8-460e-a2ed-7b2c7a5c6908 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:18.692408 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6fc57085-c2a8-460e-a2ed-7b2c7a5c6908 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:18.692840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6fc57085-c2a8-460e-a2ed-7b2c7a5c6908 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:18.824655 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9d96f66e-14a3-4fe4-bdc8-4d5b8e51402e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:18.835721 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9d96f66e-14a3-4fe4-bdc8-4d5b8e51402e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.267652 Aug 24 17:49:18.837500 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 86/163] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:18 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:18.848851 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6fc57085-c2a8-460e-a2ed-7b2c7a5c6908 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:18.857105 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6fc57085-c2a8-460e-a2ed-7b2c7a5c6908 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1271 microversion: 2.1 time: 0.182528 Aug 24 17:49:18.857689 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 78/164] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:18 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:19.171162 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:19.172239 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:19.178640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:19.179914 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:19.180506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:19.181311 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:19.181840 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:19.182335 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:19.215717 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:19.216364 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:19.217070 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:19.218143 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.objects.instance [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lazy-loading 'fault' on Instance uuid 7ca739a9-de86-4fb2-b047-7bc75fa540bb {{(pid=126994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:49:19.276341 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add01791e1374db2993c4258ec6b6d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bca50d38140438ebd32cdcb25c65e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:19.290764 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-dbb8ea24-00d9-4857-a1aa-b3612165d0ea tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 200 len: 1350 microversion: 2.1 time: 0.124589 Aug 24 17:49:19.291825 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 87/165] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:19 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 1350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:19.861860 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2ec4e9c8-3fe7-4b96-a0e3-d7ce33f0e50a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:19.862539 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2ec4e9c8-3fe7-4b96-a0e3-d7ce33f0e50a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:19.869517 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2ec4e9c8-3fe7-4b96-a0e3-d7ce33f0e50a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:19.870003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2ec4e9c8-3fe7-4b96-a0e3-d7ce33f0e50a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:19.870438 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2ec4e9c8-3fe7-4b96-a0e3-d7ce33f0e50a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:19.871133 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2ec4e9c8-3fe7-4b96-a0e3-d7ce33f0e50a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:19.871854 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2ec4e9c8-3fe7-4b96-a0e3-d7ce33f0e50a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:19.872432 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2ec4e9c8-3fe7-4b96-a0e3-d7ce33f0e50a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:19.878077 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-47b4495b-ba45-4070-899a-d0c8b11d3c17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:19.879611 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-47b4495b-ba45-4070-899a-d0c8b11d3c17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:19.886397 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-47b4495b-ba45-4070-899a-d0c8b11d3c17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:19.887160 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-47b4495b-ba45-4070-899a-d0c8b11d3c17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:19.887819 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-47b4495b-ba45-4070-899a-d0c8b11d3c17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:19.888880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-47b4495b-ba45-4070-899a-d0c8b11d3c17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:19.889391 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-47b4495b-ba45-4070-899a-d0c8b11d3c17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:19.890018 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-47b4495b-ba45-4070-899a-d0c8b11d3c17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:20.052414 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-47b4495b-ba45-4070-899a-d0c8b11d3c17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:20.062181 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-47b4495b-ba45-4070-899a-d0c8b11d3c17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1313 microversion: 2.1 time: 0.187730 Aug 24 17:49:20.063160 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 88/166] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:19 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:20.100092 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2ec4e9c8-3fe7-4b96-a0e3-d7ce33f0e50a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:20.110878 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2ec4e9c8-3fe7-4b96-a0e3-d7ce33f0e50a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.252929 Aug 24 17:49:20.121267 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 79/167] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:19 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:20.314664 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1b55d6f6-6b7a-49e7-b1ee-03922c00cd0a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:20.316204 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1b55d6f6-6b7a-49e7-b1ee-03922c00cd0a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:20.328802 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1b55d6f6-6b7a-49e7-b1ee-03922c00cd0a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:20.329791 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1b55d6f6-6b7a-49e7-b1ee-03922c00cd0a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:20.330818 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1b55d6f6-6b7a-49e7-b1ee-03922c00cd0a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:20.332528 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1b55d6f6-6b7a-49e7-b1ee-03922c00cd0a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:20.333113 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1b55d6f6-6b7a-49e7-b1ee-03922c00cd0a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:20.333964 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1b55d6f6-6b7a-49e7-b1ee-03922c00cd0a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:20.353604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-1b55d6f6-6b7a-49e7-b1ee-03922c00cd0a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] HTTP exception thrown: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1b55d6f6-6b7a-49e7-b1ee-03922c00cd0a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Request method failure captured: Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb HTTP/1.1 Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmRUwVREtS2-JwkgRqkf_XrztCYBPl4cUJFyvJ2kWl7wQ6WR50iK-ehcajZ27liZLT_jCZX5LhoO-aGvODfNMASjr1MebFeRrvu5-rVVcCEBvq2OUsSxE8VaLxeSkJGaZxdpnaeYFQWqbx10qo6_lbYBLxi6RScZyZ4fCRgH2EmYDeA Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 4bca50d38140438ebd32cdcb25c65e3d Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-DeleteServersTestJSON-540225370 Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:49:20.359337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:49:20.360634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4bca50d38140438ebd32cdcb25c65e3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bca50d38140438ebd32cdcb25c65e3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bca50d38140438ebd32cdcb25c65e3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4bca50d38140438ebd32cdcb25c65e3d"}]}] Aug 24 17:49:20.360634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-DeleteServersTestJSON-540225370 Aug 24 17:49:20.360634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 4bca50d38140438ebd32cdcb25c65e3d Aug 24 17:49:20.360634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-DeleteServersTestJSON-540225370 Aug 24 17:49:20.360634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-DeleteServersTestJSON-540225370-project Aug 24 17:49:20.360634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:49:20.360634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:49:20.360634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: add01791e1374db2993c4258ec6b6d6b Aug 24 17:49:20.360634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-DeleteServersTestJSON-540225370-project Aug 24 17:49:20.360634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:49:20.360634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:20.360634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '7ca739a9-de86-4fb2-b047-7bc75fa540bb'} Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:20.361344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:20.363332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:20.364382 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1b55d6f6-6b7a-49e7-b1ee-03922c00cd0a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Returning 404 to user: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:20.364382 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1b55d6f6-6b7a-49e7-b1ee-03922c00cd0a tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 404 len: 111 microversion: 2.1 time: 0.052418 Aug 24 17:49:20.364382 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 89/168] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:20 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:49:20.495996 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7ebe901d-7044-42e6-ab91-97ff751a280f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:20.498265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7ebe901d-7044-42e6-ab91-97ff751a280f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:20.504328 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ebe901d-7044-42e6-ab91-97ff751a280f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:20.505164 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ebe901d-7044-42e6-ab91-97ff751a280f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:20.505774 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ebe901d-7044-42e6-ab91-97ff751a280f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:20.506894 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ebe901d-7044-42e6-ab91-97ff751a280f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:20.507592 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ebe901d-7044-42e6-ab91-97ff751a280f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:20.508294 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ebe901d-7044-42e6-ab91-97ff751a280f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:20.524733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-7ebe901d-7044-42e6-ab91-97ff751a280f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] HTTP exception thrown: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7ebe901d-7044-42e6-ab91-97ff751a280f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Request method failure captured: Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb/os-volume_attachments HTTP/1.1 Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmRUwVREtS2-JwkgRqkf_XrztCYBPl4cUJFyvJ2kWl7wQ6WR50iK-ehcajZ27liZLT_jCZX5LhoO-aGvODfNMASjr1MebFeRrvu5-rVVcCEBvq2OUsSxE8VaLxeSkJGaZxdpnaeYFQWqbx10qo6_lbYBLxi6RScZyZ4fCRgH2EmYDeA Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 4bca50d38140438ebd32cdcb25c65e3d Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-DeleteServersTestJSON-540225370 Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:49:20.543425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:49:20.544830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4bca50d38140438ebd32cdcb25c65e3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bca50d38140438ebd32cdcb25c65e3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bca50d38140438ebd32cdcb25c65e3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4bca50d38140438ebd32cdcb25c65e3d"}]}] Aug 24 17:49:20.544830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-DeleteServersTestJSON-540225370 Aug 24 17:49:20.544830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 4bca50d38140438ebd32cdcb25c65e3d Aug 24 17:49:20.544830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-DeleteServersTestJSON-540225370 Aug 24 17:49:20.544830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-DeleteServersTestJSON-540225370-project Aug 24 17:49:20.544830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:49:20.544830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:49:20.544830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: add01791e1374db2993c4258ec6b6d6b Aug 24 17:49:20.544830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-DeleteServersTestJSON-540225370-project Aug 24 17:49:20.544830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:49:20.544830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:20.544830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'server_id': '7ca739a9-de86-4fb2-b047-7bc75fa540bb'} Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:20.545658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:20.546949 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:20.548891 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7ebe901d-7044-42e6-ab91-97ff751a280f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Returning 404 to user: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:20.548891 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7ebe901d-7044-42e6-ab91-97ff751a280f tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053629 Aug 24 17:49:20.549152 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 80/169] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:49:20 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb/os-volume_attachments => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:49:20.694800 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-7fbf3f81-a0d7-4562-8cfb-c1ca4304af9d req-4a9a0af4-1031-4a4a-9ee6-afce397405b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b34e887-9102-4f94-9e6a-c27e1a57e88c", "tag": "6ab83aec-b304-4396-892c-70c8bbdb208e"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:20.709125 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7fbf3f81-a0d7-4562-8cfb-c1ca4304af9d req-4a9a0af4-1031-4a4a-9ee6-afce397405b6 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:20.709496 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7fbf3f81-a0d7-4562-8cfb-c1ca4304af9d req-4a9a0af4-1031-4a4a-9ee6-afce397405b6 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:20.712039 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7fbf3f81-a0d7-4562-8cfb-c1ca4304af9d req-4a9a0af4-1031-4a4a-9ee6-afce397405b6 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:20.729604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-7fbf3f81-a0d7-4562-8cfb-c1ca4304af9d req-4a9a0af4-1031-4a4a-9ee6-afce397405b6 service nova] Creating event network-changed:6ab83aec-b304-4396-892c-70c8bbdb208e for instance 7b34e887-9102-4f94-9e6a-c27e1a57e88c on hv-cinder-84052 Aug 24 17:49:20.735002 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-7fbf3f81-a0d7-4562-8cfb-c1ca4304af9d req-4a9a0af4-1031-4a4a-9ee6-afce397405b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043695 Aug 24 17:49:20.735956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 90/170] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:21.084132 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f8820496-4fde-410e-91d3-41c374f8ed10 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:21.084896 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f8820496-4fde-410e-91d3-41c374f8ed10 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:21.091868 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f8820496-4fde-410e-91d3-41c374f8ed10 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:21.092599 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f8820496-4fde-410e-91d3-41c374f8ed10 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:21.093039 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f8820496-4fde-410e-91d3-41c374f8ed10 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:21.093740 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f8820496-4fde-410e-91d3-41c374f8ed10 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:21.094194 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f8820496-4fde-410e-91d3-41c374f8ed10 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:21.094613 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f8820496-4fde-410e-91d3-41c374f8ed10 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:21.133845 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-33cbd1b6-fd4e-4533-90b5-19966a431782 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:21.134551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-33cbd1b6-fd4e-4533-90b5-19966a431782 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:21.141163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33cbd1b6-fd4e-4533-90b5-19966a431782 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:21.141650 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33cbd1b6-fd4e-4533-90b5-19966a431782 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:21.142426 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33cbd1b6-fd4e-4533-90b5-19966a431782 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:21.143141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33cbd1b6-fd4e-4533-90b5-19966a431782 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:21.143625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33cbd1b6-fd4e-4533-90b5-19966a431782 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:21.144055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33cbd1b6-fd4e-4533-90b5-19966a431782 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:21.279692 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f8820496-4fde-410e-91d3-41c374f8ed10 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:21.288320 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-f8820496-4fde-410e-91d3-41c374f8ed10 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1313 microversion: 2.1 time: 0.208166 Aug 24 17:49:21.288973 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 81/171] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:21 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:21.304940 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-33cbd1b6-fd4e-4533-90b5-19966a431782 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:21.313316 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-33cbd1b6-fd4e-4533-90b5-19966a431782 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.183873 Aug 24 17:49:21.320762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 91/172] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:21 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:22.311644 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d1ca02f4-bdfe-4552-858e-c08964928be0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:22.315571 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d1ca02f4-bdfe-4552-858e-c08964928be0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:22.323552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d1ca02f4-bdfe-4552-858e-c08964928be0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:22.324052 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d1ca02f4-bdfe-4552-858e-c08964928be0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:22.324514 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d1ca02f4-bdfe-4552-858e-c08964928be0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:22.325224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d1ca02f4-bdfe-4552-858e-c08964928be0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:22.325756 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d1ca02f4-bdfe-4552-858e-c08964928be0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:22.326183 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d1ca02f4-bdfe-4552-858e-c08964928be0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:22.334194 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7bce23ac-5668-4d12-8c37-2dae6ca056f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:22.334912 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7bce23ac-5668-4d12-8c37-2dae6ca056f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:22.341849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7bce23ac-5668-4d12-8c37-2dae6ca056f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:22.343084 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7bce23ac-5668-4d12-8c37-2dae6ca056f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:22.343727 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7bce23ac-5668-4d12-8c37-2dae6ca056f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:22.344716 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7bce23ac-5668-4d12-8c37-2dae6ca056f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:22.345148 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7bce23ac-5668-4d12-8c37-2dae6ca056f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:22.345697 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7bce23ac-5668-4d12-8c37-2dae6ca056f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:22.498943 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7bce23ac-5668-4d12-8c37-2dae6ca056f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:22.507546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7bce23ac-5668-4d12-8c37-2dae6ca056f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.177248 Aug 24 17:49:22.508053 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 92/173] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:22 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:22.554517 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d1ca02f4-bdfe-4552-858e-c08964928be0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:22.564358 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d1ca02f4-bdfe-4552-858e-c08964928be0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1313 microversion: 2.1 time: 0.258425 Aug 24 17:49:22.565069 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 82/174] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:22 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:23.528856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a1ccc047-a7e5-422f-9ec9-1bfcff15f64d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:23.529473 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a1ccc047-a7e5-422f-9ec9-1bfcff15f64d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:23.535593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1ccc047-a7e5-422f-9ec9-1bfcff15f64d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:23.536279 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1ccc047-a7e5-422f-9ec9-1bfcff15f64d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:23.536871 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1ccc047-a7e5-422f-9ec9-1bfcff15f64d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:23.537925 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1ccc047-a7e5-422f-9ec9-1bfcff15f64d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:23.538576 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1ccc047-a7e5-422f-9ec9-1bfcff15f64d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:23.539152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1ccc047-a7e5-422f-9ec9-1bfcff15f64d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:23.587512 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8b52da5e-e201-486e-a4b9-fa382a572f7f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:23.588476 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8b52da5e-e201-486e-a4b9-fa382a572f7f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:23.595719 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b52da5e-e201-486e-a4b9-fa382a572f7f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:23.596436 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b52da5e-e201-486e-a4b9-fa382a572f7f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:23.597014 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b52da5e-e201-486e-a4b9-fa382a572f7f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:23.597730 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b52da5e-e201-486e-a4b9-fa382a572f7f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:23.598187 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b52da5e-e201-486e-a4b9-fa382a572f7f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:23.598615 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b52da5e-e201-486e-a4b9-fa382a572f7f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:23.766550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8b52da5e-e201-486e-a4b9-fa382a572f7f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:23.775728 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8b52da5e-e201-486e-a4b9-fa382a572f7f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1313 microversion: 2.1 time: 0.193757 Aug 24 17:49:23.776317 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 83/175] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:23 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:23.919820 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a1ccc047-a7e5-422f-9ec9-1bfcff15f64d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:23.932574 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a1ccc047-a7e5-422f-9ec9-1bfcff15f64d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.407557 Aug 24 17:49:23.933763 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 93/176] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:23 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:24.800373 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-49ba29ee-7e34-43aa-ae07-d2fe5b107617 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:24.801338 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-49ba29ee-7e34-43aa-ae07-d2fe5b107617 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:24.809942 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-49ba29ee-7e34-43aa-ae07-d2fe5b107617 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:24.814178 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-49ba29ee-7e34-43aa-ae07-d2fe5b107617 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:24.814689 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-49ba29ee-7e34-43aa-ae07-d2fe5b107617 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:24.823648 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-49ba29ee-7e34-43aa-ae07-d2fe5b107617 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:24.824288 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-49ba29ee-7e34-43aa-ae07-d2fe5b107617 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:24.824743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-49ba29ee-7e34-43aa-ae07-d2fe5b107617 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:24.956530 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0a7b8407-4eca-437a-a494-28e7e6b9aca9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:24.958362 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0a7b8407-4eca-437a-a494-28e7e6b9aca9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:24.966430 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:24.968617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=8 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:24.970606 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0a7b8407-4eca-437a-a494-28e7e6b9aca9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:24.971094 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0a7b8407-4eca-437a-a494-28e7e6b9aca9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:24.971545 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0a7b8407-4eca-437a-a494-28e7e6b9aca9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:24.972296 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0a7b8407-4eca-437a-a494-28e7e6b9aca9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:24.972789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0a7b8407-4eca-437a-a494-28e7e6b9aca9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:24.973561 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0a7b8407-4eca-437a-a494-28e7e6b9aca9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:25.063399 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-49ba29ee-7e34-43aa-ae07-d2fe5b107617 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:25.071758 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-49ba29ee-7e34-43aa-ae07-d2fe5b107617 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1313 microversion: 2.1 time: 0.275809 Aug 24 17:49:25.084746 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 84/177] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:24 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:25.119215 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0a7b8407-4eca-437a-a494-28e7e6b9aca9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:25.126890 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0a7b8407-4eca-437a-a494-28e7e6b9aca9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.176349 Aug 24 17:49:25.127449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 94/178] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:24 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:26.092585 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1d5ee9b0-be3b-499c-add0-e89aa60818cc tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:26.093195 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1d5ee9b0-be3b-499c-add0-e89aa60818cc tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:26.099633 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1d5ee9b0-be3b-499c-add0-e89aa60818cc tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:26.100116 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1d5ee9b0-be3b-499c-add0-e89aa60818cc tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:26.100549 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1d5ee9b0-be3b-499c-add0-e89aa60818cc tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:26.101230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1d5ee9b0-be3b-499c-add0-e89aa60818cc tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:26.101683 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1d5ee9b0-be3b-499c-add0-e89aa60818cc tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:26.102101 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1d5ee9b0-be3b-499c-add0-e89aa60818cc tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:26.148380 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-bb0b990b-0afe-4bf0-ab1d-e4d6bf9da375 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:26.148997 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-bb0b990b-0afe-4bf0-ab1d-e4d6bf9da375 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:26.154938 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bb0b990b-0afe-4bf0-ab1d-e4d6bf9da375 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:26.155456 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bb0b990b-0afe-4bf0-ab1d-e4d6bf9da375 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:26.155915 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bb0b990b-0afe-4bf0-ab1d-e4d6bf9da375 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:26.156625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bb0b990b-0afe-4bf0-ab1d-e4d6bf9da375 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:26.157073 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bb0b990b-0afe-4bf0-ab1d-e4d6bf9da375 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:26.157489 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bb0b990b-0afe-4bf0-ab1d-e4d6bf9da375 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:26.231509 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1d5ee9b0-be3b-499c-add0-e89aa60818cc tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:26.240851 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1d5ee9b0-be3b-499c-add0-e89aa60818cc tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1313 microversion: 2.1 time: 0.152343 Aug 24 17:49:26.242010 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 85/179] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:26 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:26.286465 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bb0b990b-0afe-4bf0-ab1d-e4d6bf9da375 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:26.295547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-bb0b990b-0afe-4bf0-ab1d-e4d6bf9da375 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.150980 Aug 24 17:49:26.296351 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 95/180] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:26 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:26.914269 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-9990c3bb-cca6-46c8-90db-c0528231cd86 req-f0666b90-f3ad-4cb1-8503-646bed1a48c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b34e887-9102-4f94-9e6a-c27e1a57e88c", "name": "network-vif-plugged", "status": "completed", "tag": "6ab83aec-b304-4396-892c-70c8bbdb208e"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:26.923800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-9990c3bb-cca6-46c8-90db-c0528231cd86 req-f0666b90-f3ad-4cb1-8503-646bed1a48c6 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:26.924748 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-9990c3bb-cca6-46c8-90db-c0528231cd86 req-f0666b90-f3ad-4cb1-8503-646bed1a48c6 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:26.925481 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-9990c3bb-cca6-46c8-90db-c0528231cd86 req-f0666b90-f3ad-4cb1-8503-646bed1a48c6 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:26.940382 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-9990c3bb-cca6-46c8-90db-c0528231cd86 req-f0666b90-f3ad-4cb1-8503-646bed1a48c6 service nova] Creating event network-vif-plugged:6ab83aec-b304-4396-892c-70c8bbdb208e for instance 7b34e887-9102-4f94-9e6a-c27e1a57e88c on hv-cinder-84052 Aug 24 17:49:26.946887 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-9990c3bb-cca6-46c8-90db-c0528231cd86 req-f0666b90-f3ad-4cb1-8503-646bed1a48c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037485 Aug 24 17:49:26.947928 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 86/181] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:27.262389 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e1eb3cdb-cbb6-4e56-9462-964cb44d8d1a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:27.262990 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e1eb3cdb-cbb6-4e56-9462-964cb44d8d1a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:27.268997 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1eb3cdb-cbb6-4e56-9462-964cb44d8d1a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:27.269473 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1eb3cdb-cbb6-4e56-9462-964cb44d8d1a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:27.269902 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1eb3cdb-cbb6-4e56-9462-964cb44d8d1a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:27.270812 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1eb3cdb-cbb6-4e56-9462-964cb44d8d1a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:27.271326 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1eb3cdb-cbb6-4e56-9462-964cb44d8d1a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:27.271824 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1eb3cdb-cbb6-4e56-9462-964cb44d8d1a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:27.318325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-354ab4a9-b998-4dec-b58c-14c91868a2eb tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:27.319104 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-354ab4a9-b998-4dec-b58c-14c91868a2eb tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:27.326996 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-354ab4a9-b998-4dec-b58c-14c91868a2eb tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:27.327502 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-354ab4a9-b998-4dec-b58c-14c91868a2eb tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:27.327961 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-354ab4a9-b998-4dec-b58c-14c91868a2eb tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:27.328662 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-354ab4a9-b998-4dec-b58c-14c91868a2eb tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:27.329360 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-354ab4a9-b998-4dec-b58c-14c91868a2eb tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:27.329857 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-354ab4a9-b998-4dec-b58c-14c91868a2eb tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:27.412607 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e1eb3cdb-cbb6-4e56-9462-964cb44d8d1a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:27.420801 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e1eb3cdb-cbb6-4e56-9462-964cb44d8d1a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1313 microversion: 2.1 time: 0.162106 Aug 24 17:49:27.421386 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 96/182] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:27 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:27.473170 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-354ab4a9-b998-4dec-b58c-14c91868a2eb tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:27.481325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-354ab4a9-b998-4dec-b58c-14c91868a2eb tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.167789 Aug 24 17:49:27.481887 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 87/183] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:27 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:28.142898 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9e1b51a8-19ec-45d4-902b-220eff35c020 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:28.143424 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9e1b51a8-19ec-45d4-902b-220eff35c020 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:28.149397 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e1b51a8-19ec-45d4-902b-220eff35c020 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.149876 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e1b51a8-19ec-45d4-902b-220eff35c020 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.150309 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e1b51a8-19ec-45d4-902b-220eff35c020 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:28.150990 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e1b51a8-19ec-45d4-902b-220eff35c020 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.151436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e1b51a8-19ec-45d4-902b-220eff35c020 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.151894 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e1b51a8-19ec-45d4-902b-220eff35c020 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:28.166530 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-9e1b51a8-19ec-45d4-902b-220eff35c020 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] HTTP exception thrown: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9e1b51a8-19ec-45d4-902b-220eff35c020 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Request method failure captured: Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: DELETE /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb HTTP/1.1 Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmRUwVREtS2-JwkgRqkf_XrztCYBPl4cUJFyvJ2kWl7wQ6WR50iK-ehcajZ27liZLT_jCZX5LhoO-aGvODfNMASjr1MebFeRrvu5-rVVcCEBvq2OUsSxE8VaLxeSkJGaZxdpnaeYFQWqbx10qo6_lbYBLxi6RScZyZ4fCRgH2EmYDeA Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 4bca50d38140438ebd32cdcb25c65e3d Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-DeleteServersTestJSON-540225370 Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:49:28.168208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:49:28.169748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4bca50d38140438ebd32cdcb25c65e3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bca50d38140438ebd32cdcb25c65e3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bca50d38140438ebd32cdcb25c65e3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4bca50d38140438ebd32cdcb25c65e3d"}]}] Aug 24 17:49:28.169748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-DeleteServersTestJSON-540225370 Aug 24 17:49:28.169748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 4bca50d38140438ebd32cdcb25c65e3d Aug 24 17:49:28.169748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-DeleteServersTestJSON-540225370 Aug 24 17:49:28.169748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-DeleteServersTestJSON-540225370-project Aug 24 17:49:28.169748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:49:28.169748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:49:28.169748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: add01791e1374db2993c4258ec6b6d6b Aug 24 17:49:28.169748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-DeleteServersTestJSON-540225370-project Aug 24 17:49:28.169748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:49:28.169748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:28.169748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '7ca739a9-de86-4fb2-b047-7bc75fa540bb'} Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:28.170511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:28.172229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:28.173531 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9e1b51a8-19ec-45d4-902b-220eff35c020 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Returning 404 to user: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:28.173531 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9e1b51a8-19ec-45d4-902b-220eff35c020 tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 404 len: 111 microversion: 2.1 time: 0.030474 Aug 24 17:49:28.173531 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 97/184] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:49:28 2022] DELETE /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:49:28.179603 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3322dec6-dbab-439c-998a-789b642a03dd tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:28.180513 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3322dec6-dbab-439c-998a-789b642a03dd tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] [instance: 7ca739a9-de86-4fb2-b047-7bc75fa540bb] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:28.189306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3322dec6-dbab-439c-998a-789b642a03dd tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.189905 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3322dec6-dbab-439c-998a-789b642a03dd tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.190434 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3322dec6-dbab-439c-998a-789b642a03dd tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:28.191197 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3322dec6-dbab-439c-998a-789b642a03dd tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.191757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3322dec6-dbab-439c-998a-789b642a03dd tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.192314 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3322dec6-dbab-439c-998a-789b642a03dd tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:28.207807 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-3322dec6-dbab-439c-998a-789b642a03dd tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] HTTP exception thrown: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3322dec6-dbab-439c-998a-789b642a03dd tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Request method failure captured: Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb HTTP/1.1 Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmRUwVREtS2-JwkgRqkf_XrztCYBPl4cUJFyvJ2kWl7wQ6WR50iK-ehcajZ27liZLT_jCZX5LhoO-aGvODfNMASjr1MebFeRrvu5-rVVcCEBvq2OUsSxE8VaLxeSkJGaZxdpnaeYFQWqbx10qo6_lbYBLxi6RScZyZ4fCRgH2EmYDeA Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 4bca50d38140438ebd32cdcb25c65e3d Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-DeleteServersTestJSON-540225370 Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:49:28.210306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:49:28.211627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4bca50d38140438ebd32cdcb25c65e3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bca50d38140438ebd32cdcb25c65e3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4bca50d38140438ebd32cdcb25c65e3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4bca50d38140438ebd32cdcb25c65e3d"}]}] Aug 24 17:49:28.211627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-DeleteServersTestJSON-540225370 Aug 24 17:49:28.211627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 4bca50d38140438ebd32cdcb25c65e3d Aug 24 17:49:28.211627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-DeleteServersTestJSON-540225370 Aug 24 17:49:28.211627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-DeleteServersTestJSON-540225370-project Aug 24 17:49:28.211627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:49:28.211627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:49:28.211627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: add01791e1374db2993c4258ec6b6d6b Aug 24 17:49:28.211627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-DeleteServersTestJSON-540225370-project Aug 24 17:49:28.211627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:49:28.211627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:28.211627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '7ca739a9-de86-4fb2-b047-7bc75fa540bb'} Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:28.212417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. Aug 24 17:49:28.213659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:28.214824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3322dec6-dbab-439c-998a-789b642a03dd tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] Returning 404 to user: Instance 7ca739a9-de86-4fb2-b047-7bc75fa540bb could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:28.214824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-3322dec6-dbab-439c-998a-789b642a03dd tempest-DeleteServersTestJSON-540225370 tempest-DeleteServersTestJSON-540225370-project] 10.222.0.27 "GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb" status: 404 len: 111 microversion: 2.1 time: 0.036934 Aug 24 17:49:28.214824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 88/185] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:28 2022] GET /compute/v2.1/servers/7ca739a9-de86-4fb2-b047-7bc75fa540bb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:49:28.441834 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ad782297-cf35-4f61-b562-730e3fbbb47a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:28.442437 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ad782297-cf35-4f61-b562-730e3fbbb47a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:28.448513 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ad782297-cf35-4f61-b562-730e3fbbb47a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.448988 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ad782297-cf35-4f61-b562-730e3fbbb47a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.449410 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ad782297-cf35-4f61-b562-730e3fbbb47a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:28.450117 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ad782297-cf35-4f61-b562-730e3fbbb47a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.450565 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ad782297-cf35-4f61-b562-730e3fbbb47a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.450975 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ad782297-cf35-4f61-b562-730e3fbbb47a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:28.502858 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f465cd0f-534c-46cb-af16-f261270a8cf7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:28.503652 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f465cd0f-534c-46cb-af16-f261270a8cf7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:28.512039 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f465cd0f-534c-46cb-af16-f261270a8cf7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.513110 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f465cd0f-534c-46cb-af16-f261270a8cf7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.513953 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f465cd0f-534c-46cb-af16-f261270a8cf7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:28.515109 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f465cd0f-534c-46cb-af16-f261270a8cf7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:28.515804 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f465cd0f-534c-46cb-af16-f261270a8cf7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:28.516490 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f465cd0f-534c-46cb-af16-f261270a8cf7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:28.603111 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ad782297-cf35-4f61-b562-730e3fbbb47a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:28.611360 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ad782297-cf35-4f61-b562-730e3fbbb47a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1313 microversion: 2.1 time: 0.173360 Aug 24 17:49:28.611950 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 98/186] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:28 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:29.013971 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f465cd0f-534c-46cb-af16-f261270a8cf7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:29.022278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-f465cd0f-534c-46cb-af16-f261270a8cf7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.523751 Aug 24 17:49:29.023595 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 89/187] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:28 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:29.631705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6da1f8bd-7882-4fbc-9430-afe7237ce8aa tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:29.632839 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-6da1f8bd-7882-4fbc-9430-afe7237ce8aa tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:29.640666 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6da1f8bd-7882-4fbc-9430-afe7237ce8aa tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:29.641330 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6da1f8bd-7882-4fbc-9430-afe7237ce8aa tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:29.642188 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6da1f8bd-7882-4fbc-9430-afe7237ce8aa tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:29.643206 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6da1f8bd-7882-4fbc-9430-afe7237ce8aa tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:29.643867 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6da1f8bd-7882-4fbc-9430-afe7237ce8aa tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:29.644440 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6da1f8bd-7882-4fbc-9430-afe7237ce8aa tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:29.836880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6da1f8bd-7882-4fbc-9430-afe7237ce8aa tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:29.861077 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6da1f8bd-7882-4fbc-9430-afe7237ce8aa tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1498 microversion: 2.1 time: 0.233191 Aug 24 17:49:29.862712 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 99/188] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:29 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1498 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:30.046481 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ba37d4f6-20be-43a6-9565-adc900146c69 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:30.047773 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ba37d4f6-20be-43a6-9565-adc900146c69 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:30.054577 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba37d4f6-20be-43a6-9565-adc900146c69 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:30.055064 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba37d4f6-20be-43a6-9565-adc900146c69 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:30.055515 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba37d4f6-20be-43a6-9565-adc900146c69 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:30.056272 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba37d4f6-20be-43a6-9565-adc900146c69 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:30.056892 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba37d4f6-20be-43a6-9565-adc900146c69 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:30.057321 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba37d4f6-20be-43a6-9565-adc900146c69 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:30.291357 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ba37d4f6-20be-43a6-9565-adc900146c69 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:30.301957 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ba37d4f6-20be-43a6-9565-adc900146c69 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.259368 Aug 24 17:49:30.303113 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 90/189] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:30 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:30.525069 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a1839c8e-1b0e-4c55-bf15-b6f26a16167b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:30.525253 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a1839c8e-1b0e-4c55-bf15-b6f26a16167b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:30.545974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1839c8e-1b0e-4c55-bf15-b6f26a16167b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:30.549734 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1839c8e-1b0e-4c55-bf15-b6f26a16167b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:30.550321 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1839c8e-1b0e-4c55-bf15-b6f26a16167b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:30.552269 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1839c8e-1b0e-4c55-bf15-b6f26a16167b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:30.554081 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1839c8e-1b0e-4c55-bf15-b6f26a16167b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:30.554824 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1839c8e-1b0e-4c55-bf15-b6f26a16167b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:30.605308 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a1839c8e-1b0e-4c55-bf15-b6f26a16167b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Going to try to terminate instance {{(pid=126994) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:49:30.802301 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a1839c8e-1b0e-4c55-bf15-b6f26a16167b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 204 len: 0 microversion: 2.1 time: 0.288741 Aug 24 17:49:30.807354 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 100/190] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:49:30 2022] DELETE /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:49:30.814387 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-091e10df-cf78-4e2c-87d3-2113f6d4013b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:30.815150 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-091e10df-cf78-4e2c-87d3-2113f6d4013b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:30.825577 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-091e10df-cf78-4e2c-87d3-2113f6d4013b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:30.827409 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-091e10df-cf78-4e2c-87d3-2113f6d4013b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:30.827934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-091e10df-cf78-4e2c-87d3-2113f6d4013b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:30.829127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-091e10df-cf78-4e2c-87d3-2113f6d4013b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:30.829607 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-091e10df-cf78-4e2c-87d3-2113f6d4013b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:30.833272 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-091e10df-cf78-4e2c-87d3-2113f6d4013b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:31.178195 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-091e10df-cf78-4e2c-87d3-2113f6d4013b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:31.190726 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-091e10df-cf78-4e2c-87d3-2113f6d4013b tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1504 microversion: 2.1 time: 0.381747 Aug 24 17:49:31.191783 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 91/191] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:30 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:31.325731 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f2a082ae-cfbe-4da3-8321-94c0c2821ac4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:31.326730 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f2a082ae-cfbe-4da3-8321-94c0c2821ac4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:31.338432 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f2a082ae-cfbe-4da3-8321-94c0c2821ac4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:31.339340 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f2a082ae-cfbe-4da3-8321-94c0c2821ac4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:31.340224 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f2a082ae-cfbe-4da3-8321-94c0c2821ac4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:31.341517 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f2a082ae-cfbe-4da3-8321-94c0c2821ac4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:31.342384 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f2a082ae-cfbe-4da3-8321-94c0c2821ac4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:31.342959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f2a082ae-cfbe-4da3-8321-94c0c2821ac4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:31.513314 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f2a082ae-cfbe-4da3-8321-94c0c2821ac4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:31.518431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:31.528282 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f2a082ae-cfbe-4da3-8321-94c0c2821ac4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.207650 Aug 24 17:49:31.528869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 101/192] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:31 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:32.212794 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a1b117b8-1e4c-4efb-99aa-2cc6a607ae7c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:32.215142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a1b117b8-1e4c-4efb-99aa-2cc6a607ae7c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:32.222126 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a1b117b8-1e4c-4efb-99aa-2cc6a607ae7c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:32.222885 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a1b117b8-1e4c-4efb-99aa-2cc6a607ae7c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:32.223323 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a1b117b8-1e4c-4efb-99aa-2cc6a607ae7c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:32.224078 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a1b117b8-1e4c-4efb-99aa-2cc6a607ae7c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:32.224689 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a1b117b8-1e4c-4efb-99aa-2cc6a607ae7c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:32.225124 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a1b117b8-1e4c-4efb-99aa-2cc6a607ae7c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:32.414566 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a1b117b8-1e4c-4efb-99aa-2cc6a607ae7c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:32.431023 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a1b117b8-1e4c-4efb-99aa-2cc6a607ae7c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1504 microversion: 2.1 time: 0.222302 Aug 24 17:49:32.432208 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 92/193] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:32 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:32.550506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-134c14b3-80a7-42c2-9348-a86e411cb0ce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:32.551730 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-134c14b3-80a7-42c2-9348-a86e411cb0ce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:32.559826 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-134c14b3-80a7-42c2-9348-a86e411cb0ce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:32.560528 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-134c14b3-80a7-42c2-9348-a86e411cb0ce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:32.561141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-134c14b3-80a7-42c2-9348-a86e411cb0ce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:32.561997 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-134c14b3-80a7-42c2-9348-a86e411cb0ce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:32.562456 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-134c14b3-80a7-42c2-9348-a86e411cb0ce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:32.562882 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-134c14b3-80a7-42c2-9348-a86e411cb0ce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:32.801823 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-134c14b3-80a7-42c2-9348-a86e411cb0ce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:32.815321 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-134c14b3-80a7-42c2-9348-a86e411cb0ce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.268903 Aug 24 17:49:32.815923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 102/194] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:32 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:33.452157 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-dbc3d615-b276-48fb-87d8-264f37f692b8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:33.452921 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-dbc3d615-b276-48fb-87d8-264f37f692b8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:33.459087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dbc3d615-b276-48fb-87d8-264f37f692b8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:33.459639 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dbc3d615-b276-48fb-87d8-264f37f692b8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:33.460067 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dbc3d615-b276-48fb-87d8-264f37f692b8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:33.460760 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dbc3d615-b276-48fb-87d8-264f37f692b8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:33.461380 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dbc3d615-b276-48fb-87d8-264f37f692b8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:33.461803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dbc3d615-b276-48fb-87d8-264f37f692b8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:33.611995 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-dbc3d615-b276-48fb-87d8-264f37f692b8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:33.621225 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-dbc3d615-b276-48fb-87d8-264f37f692b8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1504 microversion: 2.1 time: 0.172545 Aug 24 17:49:33.621805 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 93/195] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:33 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:33.837075 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-83b11289-e917-4de7-9aa4-698968da7e66 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:33.837683 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-83b11289-e917-4de7-9aa4-698968da7e66 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:33.844012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-83b11289-e917-4de7-9aa4-698968da7e66 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:33.844489 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-83b11289-e917-4de7-9aa4-698968da7e66 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:33.844914 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-83b11289-e917-4de7-9aa4-698968da7e66 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:33.845593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-83b11289-e917-4de7-9aa4-698968da7e66 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:33.846038 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-83b11289-e917-4de7-9aa4-698968da7e66 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:33.846451 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-83b11289-e917-4de7-9aa4-698968da7e66 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:33.982605 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-83b11289-e917-4de7-9aa4-698968da7e66 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:33.991250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-83b11289-e917-4de7-9aa4-698968da7e66 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.158399 Aug 24 17:49:33.991935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 103/196] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:33 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:34.162275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-96bf8e3f-2011-4af0-8ce9-a55c81cd9723 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Action: 'create', calling method: .version_select at 0x7f4b2a221af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-663000057", "metadata": {"Type": "work"}}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-96bf8e3f-2011-4af0-8ce9-a55c81cd9723 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Request method failure captured: Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 121 Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmSt52LolPA8n1YpGs2Rrw8CpoWQHHB5kgbMJwcDJgGLP6KC0sEeG8S0ck98vnwaC5kZWBeNhD-_0VbnkSQaRbnQ7txlLOb_2IRoJpjQsCowlAxkbIBlQWNmtRbeyGXUzsiYYvxZH2I9SBkVQg2azWSv5YXWMYwzd0e303chjKySPzE Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: d3a036ddcdf04518be6fd105bb1e6b04 Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:49:34.176325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d3a036ddcdf04518be6fd105bb1e6b04"}]}] Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: d3a036ddcdf04518be6fd105bb1e6b04 Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-VolumesNegativeTest-105458668-project Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 097ba153ea614515b069fdd10a297a28 Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-VolumesNegativeTest-105458668-project Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-663000057", "metadata": {"Type": "work"}}} Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: Aug 24 17:49:34.177680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-663000057', 'metadata': {'Type': 'work'}}}} Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:34.179108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:49:34.180548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:49:34.181734 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 17:49:34.181734 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.181734 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-96bf8e3f-2011-4af0-8ce9-a55c81cd9723 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:34.181734 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-96bf8e3f-2011-4af0-8ce9-a55c81cd9723 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131407 Aug 24 17:49:34.181734 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 94/197] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Aug 24 17:49:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:49:34.188180 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-38e8d8ee-b6a2-4dc7-a04a-28bd1b7ee058 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Action: 'create', calling method: .version_select at 0x7f4b2b8c0dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1039877164", "metadata": {"Type": "work"}}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-38e8d8ee-b6a2-4dc7-a04a-28bd1b7ee058 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Request method failure captured: Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 120 Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmSt52LolPA8n1YpGs2Rrw8CpoWQHHB5kgbMJwcDJgGLP6KC0sEeG8S0ck98vnwaC5kZWBeNhD-_0VbnkSQaRbnQ7txlLOb_2IRoJpjQsCowlAxkbIBlQWNmtRbeyGXUzsiYYvxZH2I9SBkVQg2azWSv5YXWMYwzd0e303chjKySPzE Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: d3a036ddcdf04518be6fd105bb1e6b04 Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:49:34.192883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d3a036ddcdf04518be6fd105bb1e6b04"}]}] Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: d3a036ddcdf04518be6fd105bb1e6b04 Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-VolumesNegativeTest-105458668-project Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 097ba153ea614515b069fdd10a297a28 Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-VolumesNegativeTest-105458668-project Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1039877164", "metadata": {"Type": "work"}}} Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: Aug 24 17:49:34.194286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1039877164', 'metadata': {'Type': 'work'}}}} Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi '0' Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:34.196935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:49:34.198291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:49:34.199579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 17:49:34.199579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.199579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-38e8d8ee-b6a2-4dc7-a04a-28bd1b7ee058 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:34.199579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-38e8d8ee-b6a2-4dc7-a04a-28bd1b7ee058 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009900 Aug 24 17:49:34.199579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 104/198] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Aug 24 17:49:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:49:34.202965 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-916a6156-25ef-46af-8743-c669a0fe16a4 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Action: 'create', calling method: .version_select at 0x7f4b2a1cbf70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1714797259", "metadata": {"Type": "work"}}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-916a6156-25ef-46af-8743-c669a0fe16a4 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Request method failure captured: Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 119 Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmSt52LolPA8n1YpGs2Rrw8CpoWQHHB5kgbMJwcDJgGLP6KC0sEeG8S0ck98vnwaC5kZWBeNhD-_0VbnkSQaRbnQ7txlLOb_2IRoJpjQsCowlAxkbIBlQWNmtRbeyGXUzsiYYvxZH2I9SBkVQg2azWSv5YXWMYwzd0e303chjKySPzE Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: d3a036ddcdf04518be6fd105bb1e6b04 Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:49:34.206421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d3a036ddcdf04518be6fd105bb1e6b04"}]}] Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: d3a036ddcdf04518be6fd105bb1e6b04 Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-VolumesNegativeTest-105458668-project Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 097ba153ea614515b069fdd10a297a28 Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-VolumesNegativeTest-105458668-project Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1714797259", "metadata": {"Type": "work"}}} Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: Aug 24 17:49:34.207785 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1714797259', 'metadata': {'Type': 'work'}}}} Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise error Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi '' Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:34.208619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 17:49:34.210156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 17:49:34.211400 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 17:49:34.211400 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.211400 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-916a6156-25ef-46af-8743-c669a0fe16a4 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:34.211400 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-916a6156-25ef-46af-8743-c669a0fe16a4 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008536 Aug 24 17:49:34.211400 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 95/199] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Aug 24 17:49:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:49:34.217236 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-66c1c8cf-6b82-4813-86f9-fb76a105918b tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Calling method '.version_select at 0x7f4b29aa4310>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:34.247061 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-66c1c8cf-6b82-4813-86f9-fb76a105918b tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] HTTP exception thrown: Volume tempest-invalid-486097228 could not be found. Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-66c1c8cf-6b82-4813-86f9-fb76a105918b tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Request method failure captured: Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-486097228 HTTP/1.1 Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmSt52LolPA8n1YpGs2Rrw8CpoWQHHB5kgbMJwcDJgGLP6KC0sEeG8S0ck98vnwaC5kZWBeNhD-_0VbnkSQaRbnQ7txlLOb_2IRoJpjQsCowlAxkbIBlQWNmtRbeyGXUzsiYYvxZH2I9SBkVQg2azWSv5YXWMYwzd0e303chjKySPzE Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: d3a036ddcdf04518be6fd105bb1e6b04 Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:49:34.250640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d3a036ddcdf04518be6fd105bb1e6b04"}]}] Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: d3a036ddcdf04518be6fd105bb1e6b04 Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-VolumesNegativeTest-105458668-project Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 097ba153ea614515b069fdd10a297a28 Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-VolumesNegativeTest-105458668-project Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Volume tempest-invalid-486097228 could not be found. Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': 'tempest-invalid-486097228'} Aug 24 17:49:34.251993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-486097228 could not be found. (HTTP 404) (Request-ID: req-7febe601-a306-4a43-86ed-45ceaec72b8a) Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.252703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:49:34.253870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-486097228 could not be found. Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:34.254880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-486097228 could not be found. Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-486097228 could not be found. Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-66c1c8cf-6b82-4813-86f9-fb76a105918b tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Returning 404 to user: Volume tempest-invalid-486097228 could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-66c1c8cf-6b82-4813-86f9-fb76a105918b tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-486097228" status: 404 len: 98 microversion: 2.1 time: 0.038844 Aug 24 17:49:34.256011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 105/200] 10.222.0.27 () {58 vars in 1215 bytes} [Wed Aug 24 17:49:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-486097228 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 17:49:34.262846 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-549e1f80-399e-4208-9488-f9747eb5e67c tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003661 Aug 24 17:49:34.263426 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 96/201] 10.222.0.27 () {58 vars in 1140 bytes} [Wed Aug 24 17:49:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 17:49:34.272179 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3c3b4365-8c96-43b0-8223-dcb38dd07e46 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003771 Aug 24 17:49:34.272708 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 106/202] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Aug 24 17:49:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 17:49:34.281155 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-69f61d0b-95fa-4e3f-a8ff-e00e45c757b1 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Calling method '.version_select at 0x7f4b2a46d9d0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:34.309521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-69f61d0b-95fa-4e3f-a8ff-e00e45c757b1 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] HTTP exception thrown: Volume 622a2ebd-1838-40be-99a4-360ebe162f39 could not be found. Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-69f61d0b-95fa-4e3f-a8ff-e00e45c757b1 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Request method failure captured: Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: DELETE /compute/v2.1/os-volumes/622a2ebd-1838-40be-99a4-360ebe162f39 HTTP/1.1 Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmSt52LolPA8n1YpGs2Rrw8CpoWQHHB5kgbMJwcDJgGLP6KC0sEeG8S0ck98vnwaC5kZWBeNhD-_0VbnkSQaRbnQ7txlLOb_2IRoJpjQsCowlAxkbIBlQWNmtRbeyGXUzsiYYvxZH2I9SBkVQg2azWSv5YXWMYwzd0e303chjKySPzE Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: d3a036ddcdf04518be6fd105bb1e6b04 Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:49:34.311610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d3a036ddcdf04518be6fd105bb1e6b04"}]}] Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: d3a036ddcdf04518be6fd105bb1e6b04 Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-VolumesNegativeTest-105458668-project Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 097ba153ea614515b069fdd10a297a28 Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-VolumesNegativeTest-105458668-project Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Volume 622a2ebd-1838-40be-99a4-360ebe162f39 could not be found. Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '622a2ebd-1838-40be-99a4-360ebe162f39'} Aug 24 17:49:34.312994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 622a2ebd-1838-40be-99a4-360ebe162f39 could not be found. (HTTP 404) (Request-ID: req-701c19d3-cd1f-4604-ad0c-559c4f22f215) Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.313803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:49:34.315181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 622a2ebd-1838-40be-99a4-360ebe162f39 could not be found. Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:49:34.316259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 622a2ebd-1838-40be-99a4-360ebe162f39 could not be found. Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 622a2ebd-1838-40be-99a4-360ebe162f39 could not be found. Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-69f61d0b-95fa-4e3f-a8ff-e00e45c757b1 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Returning 404 to user: Volume 622a2ebd-1838-40be-99a4-360ebe162f39 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-69f61d0b-95fa-4e3f-a8ff-e00e45c757b1 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/622a2ebd-1838-40be-99a4-360ebe162f39" status: 404 len: 109 microversion: 2.1 time: 0.035594 Aug 24 17:49:34.317817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 97/203] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 17:49:34 2022] DELETE /compute/v2.1/os-volumes/622a2ebd-1838-40be-99a4-360ebe162f39 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:49:34.322350 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-471b1900-1c2a-42ed-bc14-4aa67fb160d7 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Calling method '.version_select at 0x7f4b29aa4280>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:34.349235 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-471b1900-1c2a-42ed-bc14-4aa67fb160d7 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] HTTP exception thrown: Volume ce040b90-963a-4a9c-bcce-991d0671cb8d could not be found. Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-471b1900-1c2a-42ed-bc14-4aa67fb160d7 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Request method failure captured: Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/os-volumes/ce040b90-963a-4a9c-bcce-991d0671cb8d HTTP/1.1 Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmSt52LolPA8n1YpGs2Rrw8CpoWQHHB5kgbMJwcDJgGLP6KC0sEeG8S0ck98vnwaC5kZWBeNhD-_0VbnkSQaRbnQ7txlLOb_2IRoJpjQsCowlAxkbIBlQWNmtRbeyGXUzsiYYvxZH2I9SBkVQg2azWSv5YXWMYwzd0e303chjKySPzE Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: d3a036ddcdf04518be6fd105bb1e6b04 Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:49:34.351762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d3a036ddcdf04518be6fd105bb1e6b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d3a036ddcdf04518be6fd105bb1e6b04"}]}] Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: d3a036ddcdf04518be6fd105bb1e6b04 Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-VolumesNegativeTest-105458668 Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-VolumesNegativeTest-105458668-project Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 097ba153ea614515b069fdd10a297a28 Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-VolumesNegativeTest-105458668-project Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Volume ce040b90-963a-4a9c-bcce-991d0671cb8d could not be found. Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': 'ce040b90-963a-4a9c-bcce-991d0671cb8d'} Aug 24 17:49:34.353040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce040b90-963a-4a9c-bcce-991d0671cb8d could not be found. (HTTP 404) (Request-ID: req-60ad94ea-d992-4ed5-b14d-c4ec2c6fe4c0) Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.353742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:49:34.354870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce040b90-963a-4a9c-bcce-991d0671cb8d could not be found. Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:49:34.356097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce040b90-963a-4a9c-bcce-991d0671cb8d could not be found. Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce040b90-963a-4a9c-bcce-991d0671cb8d could not be found. Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-471b1900-1c2a-42ed-bc14-4aa67fb160d7 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] Returning 404 to user: Volume ce040b90-963a-4a9c-bcce-991d0671cb8d could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-471b1900-1c2a-42ed-bc14-4aa67fb160d7 tempest-VolumesNegativeTest-105458668 tempest-VolumesNegativeTest-105458668-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ce040b90-963a-4a9c-bcce-991d0671cb8d" status: 404 len: 109 microversion: 2.1 time: 0.034760 Aug 24 17:49:34.357304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 107/204] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:49:34 2022] GET /compute/v2.1/os-volumes/ce040b90-963a-4a9c-bcce-991d0671cb8d => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:49:34.642765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-46b6f5f1-03e0-4adc-a136-9d50d6141717 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:34.643440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-46b6f5f1-03e0-4adc-a136-9d50d6141717 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:34.649966 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-46b6f5f1-03e0-4adc-a136-9d50d6141717 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.650451 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-46b6f5f1-03e0-4adc-a136-9d50d6141717 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.650887 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-46b6f5f1-03e0-4adc-a136-9d50d6141717 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:34.651603 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-46b6f5f1-03e0-4adc-a136-9d50d6141717 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:34.652058 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-46b6f5f1-03e0-4adc-a136-9d50d6141717 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:34.652478 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-46b6f5f1-03e0-4adc-a136-9d50d6141717 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:34.836789 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-46b6f5f1-03e0-4adc-a136-9d50d6141717 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:34.845150 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-46b6f5f1-03e0-4adc-a136-9d50d6141717 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1504 microversion: 2.1 time: 0.206664 Aug 24 17:49:34.845704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 98/205] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:34 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:35.014935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ec287609-0be8-4d35-a561-c4113edfbb02 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:35.016256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ec287609-0be8-4d35-a561-c4113edfbb02 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:35.023184 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ec287609-0be8-4d35-a561-c4113edfbb02 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.023727 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ec287609-0be8-4d35-a561-c4113edfbb02 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.024636 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ec287609-0be8-4d35-a561-c4113edfbb02 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.024959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ec287609-0be8-4d35-a561-c4113edfbb02 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.025413 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ec287609-0be8-4d35-a561-c4113edfbb02 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.025827 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ec287609-0be8-4d35-a561-c4113edfbb02 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.179994 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ec287609-0be8-4d35-a561-c4113edfbb02 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:35.188944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ec287609-0be8-4d35-a561-c4113edfbb02 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.179829 Aug 24 17:49:35.189598 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 108/206] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:35 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:35.648272 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-bed12f24-aed7-45be-9f5e-0d5b8af0d778 req-f0cc260f-bbba-434a-9726-146d0d522207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b34e887-9102-4f94-9e6a-c27e1a57e88c", "name": "network-vif-deleted", "tag": "6ab83aec-b304-4396-892c-70c8bbdb208e"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:35.661155 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-bed12f24-aed7-45be-9f5e-0d5b8af0d778 req-f0cc260f-bbba-434a-9726-146d0d522207 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.661790 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-bed12f24-aed7-45be-9f5e-0d5b8af0d778 req-f0cc260f-bbba-434a-9726-146d0d522207 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.662220 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-bed12f24-aed7-45be-9f5e-0d5b8af0d778 req-f0cc260f-bbba-434a-9726-146d0d522207 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.679221 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-bed12f24-aed7-45be-9f5e-0d5b8af0d778 req-f0cc260f-bbba-434a-9726-146d0d522207 service nova] Creating event network-vif-deleted:6ab83aec-b304-4396-892c-70c8bbdb208e for instance 7b34e887-9102-4f94-9e6a-c27e1a57e88c on hv-cinder-84052 Aug 24 17:49:35.693665 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-bed12f24-aed7-45be-9f5e-0d5b8af0d778 req-f0cc260f-bbba-434a-9726-146d0d522207 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051697 Aug 24 17:49:35.695346 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 99/207] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:35.868491 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:35.869203 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:35.885401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.886178 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.886681 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.887455 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.888010 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.888439 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.931671 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:35.932163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:35.933021 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:35.933860 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.objects.instance [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lazy-loading 'fault' on Instance uuid 7b34e887-9102-4f94-9e6a-c27e1a57e88c {{(pid=126994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:49:35.986741 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:35.995294 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-96ffea3a-fd6b-4b6b-b35a-7ebdcf3119c3 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 200 len: 1303 microversion: 2.1 time: 0.132804 Aug 24 17:49:35.996101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 109/208] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:35 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:36.211916 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-86cac1f6-d8d7-4753-a7bd-b5fa5f567d70 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:36.213047 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-86cac1f6-d8d7-4753-a7bd-b5fa5f567d70 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:36.220030 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86cac1f6-d8d7-4753-a7bd-b5fa5f567d70 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.220514 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86cac1f6-d8d7-4753-a7bd-b5fa5f567d70 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.220945 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86cac1f6-d8d7-4753-a7bd-b5fa5f567d70 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.221982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86cac1f6-d8d7-4753-a7bd-b5fa5f567d70 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:36.222809 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86cac1f6-d8d7-4753-a7bd-b5fa5f567d70 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:36.223547 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86cac1f6-d8d7-4753-a7bd-b5fa5f567d70 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:36.383560 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-86cac1f6-d8d7-4753-a7bd-b5fa5f567d70 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:36.388354 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=100 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:36.393992 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-86cac1f6-d8d7-4753-a7bd-b5fa5f567d70 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.187269 Aug 24 17:49:36.395010 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 100/209] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:36 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:37.017231 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-35b1060c-a2e2-437a-b106-362b71ea3678 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:37.017925 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-35b1060c-a2e2-437a-b106-362b71ea3678 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 7b34e887-9102-4f94-9e6a-c27e1a57e88c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:37.019793 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:37.027910 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-35b1060c-a2e2-437a-b106-362b71ea3678 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.028399 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-35b1060c-a2e2-437a-b106-362b71ea3678 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.029048 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-35b1060c-a2e2-437a-b106-362b71ea3678 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.029713 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-35b1060c-a2e2-437a-b106-362b71ea3678 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.030236 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-35b1060c-a2e2-437a-b106-362b71ea3678 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.030581 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-35b1060c-a2e2-437a-b106-362b71ea3678 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.047795 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-35b1060c-a2e2-437a-b106-362b71ea3678 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] HTTP exception thrown: Instance 7b34e887-9102-4f94-9e6a-c27e1a57e88c could not be found. Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-35b1060c-a2e2-437a-b106-362b71ea3678 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Request method failure captured: Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c HTTP/1.1 Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmSUuSGfkrRZFjozbwA_0R56SFidVwscWu5ufs6AVv65lvTZZhlznpGPRwUQK1iTICi4d9mtAoLldVyBkVgQxTjUbz1VrTEtMmER76FiJVCR5hlsqMzt9Djk7FwejTC18CqDOT_YglOIC3MlGNPLjjRNTCRDYo-90OmtCt6Kha69lRY Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: f62f652ab66a4289be10048e1c8169d6 Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-VolumesActionsTest-969372950 Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:49:37.049515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:49:37.051054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f62f652ab66a4289be10048e1c8169d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62f652ab66a4289be10048e1c8169d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62f652ab66a4289be10048e1c8169d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f62f652ab66a4289be10048e1c8169d6"}]}] Aug 24 17:49:37.051054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-VolumesActionsTest-969372950 Aug 24 17:49:37.051054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: f62f652ab66a4289be10048e1c8169d6 Aug 24 17:49:37.051054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-VolumesActionsTest-969372950 Aug 24 17:49:37.051054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-VolumesActionsTest-969372950-project Aug 24 17:49:37.051054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:49:37.051054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:49:37.051054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 4aa761298e1f45e08fe4e42fba210d2b Aug 24 17:49:37.051054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-VolumesActionsTest-969372950-project Aug 24 17:49:37.051054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:49:37.051054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 7b34e887-9102-4f94-9e6a-c27e1a57e88c could not be found. Aug 24 17:49:37.051054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '7b34e887-9102-4f94-9e6a-c27e1a57e88c'} Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b34e887-9102-4f94-9e6a-c27e1a57e88c could not be found. Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:49:37.051948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b34e887-9102-4f94-9e6a-c27e1a57e88c could not be found. Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b34e887-9102-4f94-9e6a-c27e1a57e88c could not be found. Aug 24 17:49:37.053468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:49:37.054738 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-35b1060c-a2e2-437a-b106-362b71ea3678 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Returning 404 to user: Instance 7b34e887-9102-4f94-9e6a-c27e1a57e88c could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:49:37.054738 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-35b1060c-a2e2-437a-b106-362b71ea3678 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c" status: 404 len: 111 microversion: 2.1 time: 0.037926 Aug 24 17:49:37.054738 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 110/210] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:37 2022] GET /compute/v2.1/servers/7b34e887-9102-4f94-9e6a-c27e1a57e88c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:49:37.179646 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1734671308", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "networks": [{"uuid": "36e38d0d-5ac8-4cf5-ac87-8b158b40ef79"}]}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:37.236407 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] validate_networks() for [('36e38d0d-5ac8-4cf5-ac87-8b158b40ef79', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:49:37.416534 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-22d3f1dc-b6fb-40fd-ac20-c0cf6a752abf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:37.417548 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-22d3f1dc-b6fb-40fd-ac20-c0cf6a752abf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:37.423427 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-22d3f1dc-b6fb-40fd-ac20-c0cf6a752abf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.424649 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-22d3f1dc-b6fb-40fd-ac20-c0cf6a752abf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.425030 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-22d3f1dc-b6fb-40fd-ac20-c0cf6a752abf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.425903 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-22d3f1dc-b6fb-40fd-ac20-c0cf6a752abf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.426357 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-22d3f1dc-b6fb-40fd-ac20-c0cf6a752abf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.426773 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-22d3f1dc-b6fb-40fd-ac20-c0cf6a752abf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.610251 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-22d3f1dc-b6fb-40fd-ac20-c0cf6a752abf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:37.624086 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-22d3f1dc-b6fb-40fd-ac20-c0cf6a752abf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.211217 Aug 24 17:49:37.625274 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 111/211] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:37 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:37.646053 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:49:37.646480 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:49:37.647629 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:49:37.648005 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:49:37.648673 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:49:37.658579 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.659100 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.659688 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.660578 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:37.661126 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:37.661649 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:37.682644 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Getting quotas for project f62f652ab66a4289be10048e1c8169d6. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:49:37.686844 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Getting quotas for user 4aa761298e1f45e08fe4e42fba210d2b and project f62f652ab66a4289be10048e1c8169d6. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:49:37.698137 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:49:37.700476 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:49:37.750113 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-24214ee7-1fff-4624-8b0d-d4d022b1c960 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574634 Aug 24 17:49:37.750766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 101/212] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:49:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:49:37.762761 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5b4d7bbd-64a5-4e44-9015-a29bfd2fcaa8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:37.763366 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5b4d7bbd-64a5-4e44-9015-a29bfd2fcaa8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:37.824280 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5b4d7bbd-64a5-4e44-9015-a29bfd2fcaa8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:37.832035 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5b4d7bbd-64a5-4e44-9015-a29bfd2fcaa8 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1214 microversion: 2.1 time: 0.072901 Aug 24 17:49:37.835854 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 112/213] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:37 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:38.645327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c3581496-3c59-435e-b270-0a55d3fa239e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:38.646541 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c3581496-3c59-435e-b270-0a55d3fa239e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:38.648895 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:38.654963 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c3581496-3c59-435e-b270-0a55d3fa239e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.655442 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c3581496-3c59-435e-b270-0a55d3fa239e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.656085 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c3581496-3c59-435e-b270-0a55d3fa239e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.656959 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c3581496-3c59-435e-b270-0a55d3fa239e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.657409 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c3581496-3c59-435e-b270-0a55d3fa239e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.657951 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c3581496-3c59-435e-b270-0a55d3fa239e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.801411 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c3581496-3c59-435e-b270-0a55d3fa239e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:38.810089 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c3581496-3c59-435e-b270-0a55d3fa239e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.169079 Aug 24 17:49:38.810649 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 102/214] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:38 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:38.854900 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-bd25c89a-c1cb-4a03-b2aa-0a4110d28291 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:38.855688 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-bd25c89a-c1cb-4a03-b2aa-0a4110d28291 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:38.862285 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bd25c89a-c1cb-4a03-b2aa-0a4110d28291 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.862773 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bd25c89a-c1cb-4a03-b2aa-0a4110d28291 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.863250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bd25c89a-c1cb-4a03-b2aa-0a4110d28291 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.863971 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bd25c89a-c1cb-4a03-b2aa-0a4110d28291 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:38.864423 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bd25c89a-c1cb-4a03-b2aa-0a4110d28291 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:38.864851 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bd25c89a-c1cb-4a03-b2aa-0a4110d28291 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:38.927596 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bd25c89a-c1cb-4a03-b2aa-0a4110d28291 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:38.935161 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-bd25c89a-c1cb-4a03-b2aa-0a4110d28291 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1218 microversion: 2.1 time: 0.085154 Aug 24 17:49:38.935759 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 113/215] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:38 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:39.831975 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7c20829b-afa9-48f0-b434-af52d4eecaa3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:39.832598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7c20829b-afa9-48f0-b434-af52d4eecaa3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:39.840375 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7c20829b-afa9-48f0-b434-af52d4eecaa3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.843594 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7c20829b-afa9-48f0-b434-af52d4eecaa3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.844464 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7c20829b-afa9-48f0-b434-af52d4eecaa3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.845648 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7c20829b-afa9-48f0-b434-af52d4eecaa3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.846084 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7c20829b-afa9-48f0-b434-af52d4eecaa3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.846733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7c20829b-afa9-48f0-b434-af52d4eecaa3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.955273 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-61905088-6848-4243-a0d4-21461f4c4f11 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:39.955884 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-61905088-6848-4243-a0d4-21461f4c4f11 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:39.962146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-61905088-6848-4243-a0d4-21461f4c4f11 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.962963 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-61905088-6848-4243-a0d4-21461f4c4f11 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.963679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-61905088-6848-4243-a0d4-21461f4c4f11 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:39.964448 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-61905088-6848-4243-a0d4-21461f4c4f11 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:39.965113 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-61905088-6848-4243-a0d4-21461f4c4f11 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:39.965764 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-61905088-6848-4243-a0d4-21461f4c4f11 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:40.045044 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-61905088-6848-4243-a0d4-21461f4c4f11 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:40.057147 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-61905088-6848-4243-a0d4-21461f4c4f11 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1284 microversion: 2.1 time: 0.105624 Aug 24 17:49:40.057733 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 114/216] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:39 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:40.141637 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7c20829b-afa9-48f0-b434-af52d4eecaa3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:40.149421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7c20829b-afa9-48f0-b434-af52d4eecaa3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.321317 Aug 24 17:49:40.150212 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 103/217] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:39 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:41.078199 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-380d07e3-dd28-489e-b80a-707ab6c7fbf0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:41.078807 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-380d07e3-dd28-489e-b80a-707ab6c7fbf0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:41.085773 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-380d07e3-dd28-489e-b80a-707ab6c7fbf0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.086256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-380d07e3-dd28-489e-b80a-707ab6c7fbf0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.086683 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-380d07e3-dd28-489e-b80a-707ab6c7fbf0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.087379 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-380d07e3-dd28-489e-b80a-707ab6c7fbf0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.087862 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-380d07e3-dd28-489e-b80a-707ab6c7fbf0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.088278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-380d07e3-dd28-489e-b80a-707ab6c7fbf0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.171441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-24e3fa5c-0adb-4941-ba30-d150c9db7969 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:41.172412 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-24e3fa5c-0adb-4941-ba30-d150c9db7969 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:41.183201 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24e3fa5c-0adb-4941-ba30-d150c9db7969 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.184232 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24e3fa5c-0adb-4941-ba30-d150c9db7969 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.185093 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24e3fa5c-0adb-4941-ba30-d150c9db7969 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.186316 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24e3fa5c-0adb-4941-ba30-d150c9db7969 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.187031 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24e3fa5c-0adb-4941-ba30-d150c9db7969 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.187827 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24e3fa5c-0adb-4941-ba30-d150c9db7969 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.235670 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-380d07e3-dd28-489e-b80a-707ab6c7fbf0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:41.244115 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-380d07e3-dd28-489e-b80a-707ab6c7fbf0 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.169728 Aug 24 17:49:41.244927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 115/218] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:41 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:41.261646 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-3cc3a5a5-e323-4990-a431-c81bb0457f24 req-8913c399-9c49-470c-96b0-1ed9854fe735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec10b81-73e5-43ff-ae13-ae07ceefc4d1", "tag": "bc133561-95a4-45ac-99c4-226e108c6b87"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:41.274742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-3cc3a5a5-e323-4990-a431-c81bb0457f24 req-8913c399-9c49-470c-96b0-1ed9854fe735 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:41.275324 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-3cc3a5a5-e323-4990-a431-c81bb0457f24 req-8913c399-9c49-470c-96b0-1ed9854fe735 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:41.275769 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-3cc3a5a5-e323-4990-a431-c81bb0457f24 req-8913c399-9c49-470c-96b0-1ed9854fe735 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:41.288349 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-3cc3a5a5-e323-4990-a431-c81bb0457f24 req-8913c399-9c49-470c-96b0-1ed9854fe735 service nova] Creating event network-changed:bc133561-95a4-45ac-99c4-226e108c6b87 for instance 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 on hv-cinder-84052 Aug 24 17:49:41.294701 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-3cc3a5a5-e323-4990-a431-c81bb0457f24 req-8913c399-9c49-470c-96b0-1ed9854fe735 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040195 Aug 24 17:49:41.295709 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 116/219] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:49:41.379962 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-24e3fa5c-0adb-4941-ba30-d150c9db7969 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:41.388329 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-24e3fa5c-0adb-4941-ba30-d150c9db7969 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.220921 Aug 24 17:49:41.388894 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 104/220] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:41 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:42.265736 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d8d1bf1a-8b90-43ac-98f1-853d32ed3a31 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:42.266488 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d8d1bf1a-8b90-43ac-98f1-853d32ed3a31 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:42.274581 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d8d1bf1a-8b90-43ac-98f1-853d32ed3a31 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:42.275073 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d8d1bf1a-8b90-43ac-98f1-853d32ed3a31 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:42.275604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d8d1bf1a-8b90-43ac-98f1-853d32ed3a31 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.276349 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d8d1bf1a-8b90-43ac-98f1-853d32ed3a31 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:42.276808 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d8d1bf1a-8b90-43ac-98f1-853d32ed3a31 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:42.277262 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d8d1bf1a-8b90-43ac-98f1-853d32ed3a31 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.405191 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d8d1bf1a-8b90-43ac-98f1-853d32ed3a31 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:42.412623 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-fac8d25f-899f-4eb3-8295-d79b90edd699 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:42.413274 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-fac8d25f-899f-4eb3-8295-d79b90edd699 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:42.416943 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d8d1bf1a-8b90-43ac-98f1-853d32ed3a31 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.155427 Aug 24 17:49:42.417582 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 117/221] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:42 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:42.419864 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fac8d25f-899f-4eb3-8295-d79b90edd699 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:42.420347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fac8d25f-899f-4eb3-8295-d79b90edd699 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:42.420779 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fac8d25f-899f-4eb3-8295-d79b90edd699 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.421473 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fac8d25f-899f-4eb3-8295-d79b90edd699 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:42.421928 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fac8d25f-899f-4eb3-8295-d79b90edd699 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:42.422353 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fac8d25f-899f-4eb3-8295-d79b90edd699 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:42.549484 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-fac8d25f-899f-4eb3-8295-d79b90edd699 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:42.557226 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-fac8d25f-899f-4eb3-8295-d79b90edd699 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.150812 Aug 24 17:49:42.557786 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 105/222] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:42 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:43.437708 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-247482d6-cc23-49f8-807c-d2f9e6750b79 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:43.438325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-247482d6-cc23-49f8-807c-d2f9e6750b79 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:43.445233 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-247482d6-cc23-49f8-807c-d2f9e6750b79 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.445357 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-247482d6-cc23-49f8-807c-d2f9e6750b79 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.445722 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-247482d6-cc23-49f8-807c-d2f9e6750b79 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.446418 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-247482d6-cc23-49f8-807c-d2f9e6750b79 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.446876 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-247482d6-cc23-49f8-807c-d2f9e6750b79 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.447302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-247482d6-cc23-49f8-807c-d2f9e6750b79 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.578500 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4e62d7df-140c-4fc0-9985-029d77725dbe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:43.579251 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4e62d7df-140c-4fc0-9985-029d77725dbe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:43.579453 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-247482d6-cc23-49f8-807c-d2f9e6750b79 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:43.586370 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4e62d7df-140c-4fc0-9985-029d77725dbe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.586932 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4e62d7df-140c-4fc0-9985-029d77725dbe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.587603 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4e62d7df-140c-4fc0-9985-029d77725dbe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.587783 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-247482d6-cc23-49f8-807c-d2f9e6750b79 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.154023 Aug 24 17:49:43.588433 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4e62d7df-140c-4fc0-9985-029d77725dbe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:43.588656 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 118/223] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:43 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:43.588895 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4e62d7df-140c-4fc0-9985-029d77725dbe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:43.589320 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4e62d7df-140c-4fc0-9985-029d77725dbe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:43.721507 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4e62d7df-140c-4fc0-9985-029d77725dbe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:43.729334 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4e62d7df-140c-4fc0-9985-029d77725dbe tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.154987 Aug 24 17:49:43.730201 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 106/224] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:43 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:44.609695 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-57b153cb-06dc-4f17-9404-ba594cbbe583 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:44.610318 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-57b153cb-06dc-4f17-9404-ba594cbbe583 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:44.617887 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-57b153cb-06dc-4f17-9404-ba594cbbe583 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.618407 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-57b153cb-06dc-4f17-9404-ba594cbbe583 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.618846 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-57b153cb-06dc-4f17-9404-ba594cbbe583 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.619579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-57b153cb-06dc-4f17-9404-ba594cbbe583 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.620203 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-57b153cb-06dc-4f17-9404-ba594cbbe583 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.620812 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-57b153cb-06dc-4f17-9404-ba594cbbe583 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.750103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a66f197d-e20b-44e0-b94b-a501c8b39830 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:44.750662 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a66f197d-e20b-44e0-b94b-a501c8b39830 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:44.757376 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a66f197d-e20b-44e0-b94b-a501c8b39830 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.758095 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a66f197d-e20b-44e0-b94b-a501c8b39830 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.758732 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a66f197d-e20b-44e0-b94b-a501c8b39830 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.759436 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a66f197d-e20b-44e0-b94b-a501c8b39830 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:44.760072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a66f197d-e20b-44e0-b94b-a501c8b39830 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:44.760650 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a66f197d-e20b-44e0-b94b-a501c8b39830 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:44.823163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-57b153cb-06dc-4f17-9404-ba594cbbe583 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:44.837693 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-57b153cb-06dc-4f17-9404-ba594cbbe583 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.232404 Aug 24 17:49:44.857479 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 119/225] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:44 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:45.215165 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a66f197d-e20b-44e0-b94b-a501c8b39830 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:45.223297 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a66f197d-e20b-44e0-b94b-a501c8b39830 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.477005 Aug 24 17:49:45.223898 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 107/226] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:44 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:45.865514 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-191c4057-1c67-44fc-8ee0-00f8ffc60ead tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:45.866136 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-191c4057-1c67-44fc-8ee0-00f8ffc60ead tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:45.872834 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-191c4057-1c67-44fc-8ee0-00f8ffc60ead tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.873365 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-191c4057-1c67-44fc-8ee0-00f8ffc60ead tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.873785 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-191c4057-1c67-44fc-8ee0-00f8ffc60ead tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:45.874489 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-191c4057-1c67-44fc-8ee0-00f8ffc60ead tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:45.874945 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-191c4057-1c67-44fc-8ee0-00f8ffc60ead tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:45.875370 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-191c4057-1c67-44fc-8ee0-00f8ffc60ead tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:46.009834 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-191c4057-1c67-44fc-8ee0-00f8ffc60ead tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:46.019334 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-191c4057-1c67-44fc-8ee0-00f8ffc60ead tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.157810 Aug 24 17:49:46.020873 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 120/227] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:45 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:46.245083 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0ccc0dbf-2eb9-402f-9a17-1dc92593d468 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:46.245890 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0ccc0dbf-2eb9-402f-9a17-1dc92593d468 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:46.252796 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ccc0dbf-2eb9-402f-9a17-1dc92593d468 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:46.253288 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ccc0dbf-2eb9-402f-9a17-1dc92593d468 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:46.253721 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ccc0dbf-2eb9-402f-9a17-1dc92593d468 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:46.254559 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ccc0dbf-2eb9-402f-9a17-1dc92593d468 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:46.255333 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ccc0dbf-2eb9-402f-9a17-1dc92593d468 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:46.255799 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ccc0dbf-2eb9-402f-9a17-1dc92593d468 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:46.545846 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0ccc0dbf-2eb9-402f-9a17-1dc92593d468 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:46.553748 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0ccc0dbf-2eb9-402f-9a17-1dc92593d468 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.313195 Aug 24 17:49:46.554865 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 108/228] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:46 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:47.041612 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f176cf8a-e4c9-442c-bb6b-9a19b914d08c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:47.042940 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f176cf8a-e4c9-442c-bb6b-9a19b914d08c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:47.048922 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f176cf8a-e4c9-442c-bb6b-9a19b914d08c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:47.049402 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f176cf8a-e4c9-442c-bb6b-9a19b914d08c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:47.049833 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f176cf8a-e4c9-442c-bb6b-9a19b914d08c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:47.050662 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f176cf8a-e4c9-442c-bb6b-9a19b914d08c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:47.051157 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f176cf8a-e4c9-442c-bb6b-9a19b914d08c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:47.051598 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f176cf8a-e4c9-442c-bb6b-9a19b914d08c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:47.201526 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f176cf8a-e4c9-442c-bb6b-9a19b914d08c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:47.212399 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f176cf8a-e4c9-442c-bb6b-9a19b914d08c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.175226 Aug 24 17:49:47.213198 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 121/229] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:47 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:47.589800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4562f413-e43d-4b87-a249-d25a610f5c8d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:47.592532 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4562f413-e43d-4b87-a249-d25a610f5c8d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:47.613547 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4562f413-e43d-4b87-a249-d25a610f5c8d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:47.614680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4562f413-e43d-4b87-a249-d25a610f5c8d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:47.615904 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4562f413-e43d-4b87-a249-d25a610f5c8d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:47.620809 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4562f413-e43d-4b87-a249-d25a610f5c8d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:47.621848 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4562f413-e43d-4b87-a249-d25a610f5c8d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:47.623316 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4562f413-e43d-4b87-a249-d25a610f5c8d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:47.684250 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:47.693358 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=6 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:47.823169 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4562f413-e43d-4b87-a249-d25a610f5c8d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:47.842155 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4562f413-e43d-4b87-a249-d25a610f5c8d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.269310 Aug 24 17:49:47.842756 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 109/230] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:47 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:48.236679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a8742859-0089-4d0f-bf7b-295904de3608 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:48.237325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a8742859-0089-4d0f-bf7b-295904de3608 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:48.240866 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:48.245798 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8742859-0089-4d0f-bf7b-295904de3608 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.246270 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8742859-0089-4d0f-bf7b-295904de3608 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.247029 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8742859-0089-4d0f-bf7b-295904de3608 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.247765 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8742859-0089-4d0f-bf7b-295904de3608 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.248221 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8742859-0089-4d0f-bf7b-295904de3608 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.248648 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8742859-0089-4d0f-bf7b-295904de3608 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.428118 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a8742859-0089-4d0f-bf7b-295904de3608 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:48.436690 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a8742859-0089-4d0f-bf7b-295904de3608 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.203884 Aug 24 17:49:48.452089 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 122/231] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:48 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:48.865577 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e29e92c6-f697-4d42-ab34-75b36709f55a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:48.867321 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e29e92c6-f697-4d42-ab34-75b36709f55a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:48.876811 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e29e92c6-f697-4d42-ab34-75b36709f55a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.877589 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e29e92c6-f697-4d42-ab34-75b36709f55a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.878158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e29e92c6-f697-4d42-ab34-75b36709f55a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:48.879392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e29e92c6-f697-4d42-ab34-75b36709f55a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:48.879777 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e29e92c6-f697-4d42-ab34-75b36709f55a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:48.880202 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e29e92c6-f697-4d42-ab34-75b36709f55a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.042275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e29e92c6-f697-4d42-ab34-75b36709f55a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:49.058250 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e29e92c6-f697-4d42-ab34-75b36709f55a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1520 microversion: 2.1 time: 0.196973 Aug 24 17:49:49.059545 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 110/232] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:48 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:49.458144 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-009c7b55-35ea-4968-ba6c-62ac5329a97d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:49.458765 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-009c7b55-35ea-4968-ba6c-62ac5329a97d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:49.465494 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-009c7b55-35ea-4968-ba6c-62ac5329a97d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.465981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-009c7b55-35ea-4968-ba6c-62ac5329a97d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.466666 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-009c7b55-35ea-4968-ba6c-62ac5329a97d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.467380 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-009c7b55-35ea-4968-ba6c-62ac5329a97d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:49.467859 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-009c7b55-35ea-4968-ba6c-62ac5329a97d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:49.468252 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-009c7b55-35ea-4968-ba6c-62ac5329a97d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:49.629132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-009c7b55-35ea-4968-ba6c-62ac5329a97d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:49.636924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-009c7b55-35ea-4968-ba6c-62ac5329a97d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.182611 Aug 24 17:49:49.637493 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 123/233] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:49 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:50.079535 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b955eed8-fb35-4cd4-be32-c24925153c56 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:50.080109 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b955eed8-fb35-4cd4-be32-c24925153c56 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:50.087375 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b955eed8-fb35-4cd4-be32-c24925153c56 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.088052 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b955eed8-fb35-4cd4-be32-c24925153c56 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.088525 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b955eed8-fb35-4cd4-be32-c24925153c56 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.089457 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b955eed8-fb35-4cd4-be32-c24925153c56 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.089916 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b955eed8-fb35-4cd4-be32-c24925153c56 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.090336 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b955eed8-fb35-4cd4-be32-c24925153c56 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.335720 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b955eed8-fb35-4cd4-be32-c24925153c56 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:50.346200 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b955eed8-fb35-4cd4-be32-c24925153c56 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1500 microversion: 2.1 time: 0.270630 Aug 24 17:49:50.346850 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 111/234] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:50 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1500 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:50.368086 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-88e58d6b-4938-443e-9552-90f58d135ac3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:50.368708 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-88e58d6b-4938-443e-9552-90f58d135ac3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:50.374959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-88e58d6b-4938-443e-9552-90f58d135ac3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.375655 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-88e58d6b-4938-443e-9552-90f58d135ac3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.376244 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-88e58d6b-4938-443e-9552-90f58d135ac3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.377430 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-88e58d6b-4938-443e-9552-90f58d135ac3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.378105 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-88e58d6b-4938-443e-9552-90f58d135ac3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.378681 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-88e58d6b-4938-443e-9552-90f58d135ac3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.404579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=100 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:50.581974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-88e58d6b-4938-443e-9552-90f58d135ac3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:50.594470 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-88e58d6b-4938-443e-9552-90f58d135ac3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1516 microversion: 2.1 time: 0.229887 Aug 24 17:49:50.595280 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 124/235] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:50 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1516 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:50.658199 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-29baf8d9-aad4-4e19-9b9a-1385ca9dcdcf tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:50.658944 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-29baf8d9-aad4-4e19-9b9a-1385ca9dcdcf tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:50.665142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-29baf8d9-aad4-4e19-9b9a-1385ca9dcdcf tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.665626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-29baf8d9-aad4-4e19-9b9a-1385ca9dcdcf tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.666053 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-29baf8d9-aad4-4e19-9b9a-1385ca9dcdcf tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.666801 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-29baf8d9-aad4-4e19-9b9a-1385ca9dcdcf tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.667248 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-29baf8d9-aad4-4e19-9b9a-1385ca9dcdcf tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.667691 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-29baf8d9-aad4-4e19-9b9a-1385ca9dcdcf tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.843514 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-f618c7b4-af58-47d2-958e-15b756aa0d2e req-23e57c7f-0eda-45e3-abaf-98d1b5bcfb97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec10b81-73e5-43ff-ae13-ae07ceefc4d1", "name": "network-vif-plugged", "status": "completed", "tag": "bc133561-95a4-45ac-99c4-226e108c6b87"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:50.853313 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-f618c7b4-af58-47d2-958e-15b756aa0d2e req-23e57c7f-0eda-45e3-abaf-98d1b5bcfb97 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:50.854095 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-f618c7b4-af58-47d2-958e-15b756aa0d2e req-23e57c7f-0eda-45e3-abaf-98d1b5bcfb97 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:50.854765 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-f618c7b4-af58-47d2-958e-15b756aa0d2e req-23e57c7f-0eda-45e3-abaf-98d1b5bcfb97 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:50.876244 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-f618c7b4-af58-47d2-958e-15b756aa0d2e req-23e57c7f-0eda-45e3-abaf-98d1b5bcfb97 service nova] Creating event network-vif-plugged:bc133561-95a4-45ac-99c4-226e108c6b87 for instance 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 on hv-cinder-84052 Aug 24 17:49:50.888324 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-f618c7b4-af58-47d2-958e-15b756aa0d2e req-23e57c7f-0eda-45e3-abaf-98d1b5bcfb97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048932 Aug 24 17:49:50.889113 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 125/236] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:49:50.892320 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-29baf8d9-aad4-4e19-9b9a-1385ca9dcdcf tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:50.900716 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-29baf8d9-aad4-4e19-9b9a-1385ca9dcdcf tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.246455 Aug 24 17:49:50.905276 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 112/237] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:50 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:51.922201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b491446c-c72e-4db1-855d-45abea29b8cd tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:51.922841 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b491446c-c72e-4db1-855d-45abea29b8cd tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:51.931031 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b491446c-c72e-4db1-855d-45abea29b8cd tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.932507 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b491446c-c72e-4db1-855d-45abea29b8cd tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.932955 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b491446c-c72e-4db1-855d-45abea29b8cd tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:51.933678 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b491446c-c72e-4db1-855d-45abea29b8cd tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:51.934286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b491446c-c72e-4db1-855d-45abea29b8cd tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:51.934723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b491446c-c72e-4db1-855d-45abea29b8cd tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:52.114764 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b491446c-c72e-4db1-855d-45abea29b8cd tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:52.123557 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b491446c-c72e-4db1-855d-45abea29b8cd tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.205632 Aug 24 17:49:52.124106 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 126/238] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:51 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:53.102457 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4aa27be2-824c-4e82-9dce-7767ec923ef1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:49:53.105028 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4aa27be2-824c-4e82-9dce-7767ec923ef1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:53.111330 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4aa27be2-824c-4e82-9dce-7767ec923ef1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.111839 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4aa27be2-824c-4e82-9dce-7767ec923ef1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.112267 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4aa27be2-824c-4e82-9dce-7767ec923ef1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.112952 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4aa27be2-824c-4e82-9dce-7767ec923ef1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.113402 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4aa27be2-824c-4e82-9dce-7767ec923ef1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.113849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4aa27be2-824c-4e82-9dce-7767ec923ef1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.140841 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-4aa27be2-824c-4e82-9dce-7767ec923ef1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lazy-loading 'flavor' on Instance uuid 0397fbeb-25d8-46af-98bb-8a7b70c97f48 {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:49:53.145178 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6b37e56a-d3d0-43b5-ba1b-7232764adc17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:53.145928 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-6b37e56a-d3d0-43b5-ba1b-7232764adc17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:53.153752 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b37e56a-d3d0-43b5-ba1b-7232764adc17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.154500 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b37e56a-d3d0-43b5-ba1b-7232764adc17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.154953 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b37e56a-d3d0-43b5-ba1b-7232764adc17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.155661 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b37e56a-d3d0-43b5-ba1b-7232764adc17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.156113 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b37e56a-d3d0-43b5-ba1b-7232764adc17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.156531 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b37e56a-d3d0-43b5-ba1b-7232764adc17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.222247 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4aa27be2-824c-4e82-9dce-7767ec923ef1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "POST /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48/action" status: 200 len: 32 microversion: 2.1 time: 0.124403 Aug 24 17:49:53.223046 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 113/239] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:49:53 2022] POST /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:49:53.233602 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-96fab3b5-ba49-463a-bb98-21309cc8fd0d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:53.235862 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-96fab3b5-ba49-463a-bb98-21309cc8fd0d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:53.243399 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-96fab3b5-ba49-463a-bb98-21309cc8fd0d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.243993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-96fab3b5-ba49-463a-bb98-21309cc8fd0d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.244506 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-96fab3b5-ba49-463a-bb98-21309cc8fd0d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.245239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-96fab3b5-ba49-463a-bb98-21309cc8fd0d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:53.245696 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-96fab3b5-ba49-463a-bb98-21309cc8fd0d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:53.246324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-96fab3b5-ba49-463a-bb98-21309cc8fd0d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:53.300821 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6b37e56a-d3d0-43b5-ba1b-7232764adc17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:53.309461 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6b37e56a-d3d0-43b5-ba1b-7232764adc17 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.169095 Aug 24 17:49:53.310333 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 127/240] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:53 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:53.408091 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-96fab3b5-ba49-463a-bb98-21309cc8fd0d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:53.420588 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-96fab3b5-ba49-463a-bb98-21309cc8fd0d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.191325 Aug 24 17:49:53.422569 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 114/241] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:53 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:54.329925 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d9ede3fa-182b-4853-9c3f-5d4180176a41 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:54.330766 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d9ede3fa-182b-4853-9c3f-5d4180176a41 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:54.337282 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d9ede3fa-182b-4853-9c3f-5d4180176a41 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.337769 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d9ede3fa-182b-4853-9c3f-5d4180176a41 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.338202 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d9ede3fa-182b-4853-9c3f-5d4180176a41 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.338895 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d9ede3fa-182b-4853-9c3f-5d4180176a41 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.339349 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d9ede3fa-182b-4853-9c3f-5d4180176a41 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.339892 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d9ede3fa-182b-4853-9c3f-5d4180176a41 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.442360 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-62c76bef-318c-4d91-989e-b585f016f68e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:54.443080 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-62c76bef-318c-4d91-989e-b585f016f68e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:54.450277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-62c76bef-318c-4d91-989e-b585f016f68e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.450748 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-62c76bef-318c-4d91-989e-b585f016f68e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.451184 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-62c76bef-318c-4d91-989e-b585f016f68e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.451928 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-62c76bef-318c-4d91-989e-b585f016f68e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:54.452527 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-62c76bef-318c-4d91-989e-b585f016f68e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:54.453105 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-62c76bef-318c-4d91-989e-b585f016f68e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:54.478755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d9ede3fa-182b-4853-9c3f-5d4180176a41 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:54.486607 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d9ede3fa-182b-4853-9c3f-5d4180176a41 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.160517 Aug 24 17:49:54.487175 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 128/242] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:54 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:54.582602 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-62c76bef-318c-4d91-989e-b585f016f68e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:54.590542 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-62c76bef-318c-4d91-989e-b585f016f68e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.152137 Aug 24 17:49:54.591110 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 115/243] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:54 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:55.506157 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e1783a4b-34a9-44dd-9b67-2727db22ac7e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:55.506805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e1783a4b-34a9-44dd-9b67-2727db22ac7e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:55.513256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1783a4b-34a9-44dd-9b67-2727db22ac7e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.513733 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1783a4b-34a9-44dd-9b67-2727db22ac7e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.514161 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1783a4b-34a9-44dd-9b67-2727db22ac7e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.514840 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1783a4b-34a9-44dd-9b67-2727db22ac7e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.515284 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1783a4b-34a9-44dd-9b67-2727db22ac7e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.515756 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e1783a4b-34a9-44dd-9b67-2727db22ac7e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.611731 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5b233d6a-2733-47f0-9a0f-9859bfb8b664 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:55.612564 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5b233d6a-2733-47f0-9a0f-9859bfb8b664 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:55.620362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b233d6a-2733-47f0-9a0f-9859bfb8b664 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.620932 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b233d6a-2733-47f0-9a0f-9859bfb8b664 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.621439 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b233d6a-2733-47f0-9a0f-9859bfb8b664 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.622223 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b233d6a-2733-47f0-9a0f-9859bfb8b664 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:55.622748 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b233d6a-2733-47f0-9a0f-9859bfb8b664 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:55.623240 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b233d6a-2733-47f0-9a0f-9859bfb8b664 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:55.627545 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:49:55.644215 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e1783a4b-34a9-44dd-9b67-2727db22ac7e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:55.652072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e1783a4b-34a9-44dd-9b67-2727db22ac7e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1314 microversion: 2.1 time: 0.149669 Aug 24 17:49:55.652908 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 129/244] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:55 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:55.754653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-5b233d6a-2733-47f0-9a0f-9859bfb8b664 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:55.762369 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5b233d6a-2733-47f0-9a0f-9859bfb8b664 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.154515 Aug 24 17:49:55.762937 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 116/245] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:55 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:56.673482 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b79cc6f0-4c7b-49f7-a6db-a0570d24147c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:56.674112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b79cc6f0-4c7b-49f7-a6db-a0570d24147c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:56.680157 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b79cc6f0-4c7b-49f7-a6db-a0570d24147c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:56.680649 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b79cc6f0-4c7b-49f7-a6db-a0570d24147c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:56.681088 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b79cc6f0-4c7b-49f7-a6db-a0570d24147c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:56.681785 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b79cc6f0-4c7b-49f7-a6db-a0570d24147c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:56.682243 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b79cc6f0-4c7b-49f7-a6db-a0570d24147c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:56.682667 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b79cc6f0-4c7b-49f7-a6db-a0570d24147c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:56.783901 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8ad735c8-d71f-40b7-9f38-18dfcf94abd2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:56.784515 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8ad735c8-d71f-40b7-9f38-18dfcf94abd2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:56.791397 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8ad735c8-d71f-40b7-9f38-18dfcf94abd2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:56.792183 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8ad735c8-d71f-40b7-9f38-18dfcf94abd2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:56.792690 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8ad735c8-d71f-40b7-9f38-18dfcf94abd2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:56.793563 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8ad735c8-d71f-40b7-9f38-18dfcf94abd2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:56.794097 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8ad735c8-d71f-40b7-9f38-18dfcf94abd2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:56.794519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8ad735c8-d71f-40b7-9f38-18dfcf94abd2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:56.823750 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b79cc6f0-4c7b-49f7-a6db-a0570d24147c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:56.831519 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b79cc6f0-4c7b-49f7-a6db-a0570d24147c tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1498 microversion: 2.1 time: 0.161959 Aug 24 17:49:56.832113 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 130/246] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:56 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:57.017580 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8ad735c8-d71f-40b7-9f38-18dfcf94abd2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:57.027750 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8ad735c8-d71f-40b7-9f38-18dfcf94abd2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.247803 Aug 24 17:49:57.028437 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 117/247] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:56 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:49:57.512236 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-17b6084e-fbb0-4883-8d27-f1510e7065b7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:57.512811 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-17b6084e-fbb0-4883-8d27-f1510e7065b7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:57.523022 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17b6084e-fbb0-4883-8d27-f1510e7065b7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:57.523022 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17b6084e-fbb0-4883-8d27-f1510e7065b7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:57.523022 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17b6084e-fbb0-4883-8d27-f1510e7065b7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:57.523022 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17b6084e-fbb0-4883-8d27-f1510e7065b7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:57.523502 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17b6084e-fbb0-4883-8d27-f1510e7065b7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:57.523502 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17b6084e-fbb0-4883-8d27-f1510e7065b7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:57.555532 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-17b6084e-fbb0-4883-8d27-f1510e7065b7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Going to try to terminate instance {{(pid=126994) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:49:57.662956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-17b6084e-fbb0-4883-8d27-f1510e7065b7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 204 len: 0 microversion: 2.1 time: 0.153895 Aug 24 17:49:57.663961 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 131/248] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:49:57 2022] DELETE /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:49:57.672838 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2d697df1-c1a6-431a-8bd3-dc6115e1c2b9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:57.673429 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2d697df1-c1a6-431a-8bd3-dc6115e1c2b9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:57.680440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2d697df1-c1a6-431a-8bd3-dc6115e1c2b9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:57.681072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2d697df1-c1a6-431a-8bd3-dc6115e1c2b9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:57.681529 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2d697df1-c1a6-431a-8bd3-dc6115e1c2b9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:57.682232 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2d697df1-c1a6-431a-8bd3-dc6115e1c2b9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:57.682696 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2d697df1-c1a6-431a-8bd3-dc6115e1c2b9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:57.683761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2d697df1-c1a6-431a-8bd3-dc6115e1c2b9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:57.823441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2d697df1-c1a6-431a-8bd3-dc6115e1c2b9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:57.831391 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2d697df1-c1a6-431a-8bd3-dc6115e1c2b9 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1504 microversion: 2.1 time: 0.162958 Aug 24 17:49:57.831991 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 118/249] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:57 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:58.051278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-169c8f00-18e5-4f87-a2b9-b770420416e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:58.052088 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-169c8f00-18e5-4f87-a2b9-b770420416e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:58.059161 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-169c8f00-18e5-4f87-a2b9-b770420416e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.059696 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-169c8f00-18e5-4f87-a2b9-b770420416e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.060135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-169c8f00-18e5-4f87-a2b9-b770420416e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.060866 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-169c8f00-18e5-4f87-a2b9-b770420416e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.061330 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-169c8f00-18e5-4f87-a2b9-b770420416e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.061750 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-169c8f00-18e5-4f87-a2b9-b770420416e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.196640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-169c8f00-18e5-4f87-a2b9-b770420416e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:58.204596 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-169c8f00-18e5-4f87-a2b9-b770420416e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.157540 Aug 24 17:49:58.205327 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 132/250] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:58 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:58.854062 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d590b206-a54e-41fe-99d4-2040907222f7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:58.854677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d590b206-a54e-41fe-99d4-2040907222f7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:58.861077 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d590b206-a54e-41fe-99d4-2040907222f7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.861558 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d590b206-a54e-41fe-99d4-2040907222f7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.861997 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d590b206-a54e-41fe-99d4-2040907222f7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:58.862685 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d590b206-a54e-41fe-99d4-2040907222f7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:58.863136 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d590b206-a54e-41fe-99d4-2040907222f7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:58.863583 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d590b206-a54e-41fe-99d4-2040907222f7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:59.000685 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d590b206-a54e-41fe-99d4-2040907222f7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:59.009475 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d590b206-a54e-41fe-99d4-2040907222f7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1504 microversion: 2.1 time: 0.159641 Aug 24 17:49:59.009943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 119/251] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:58 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:49:59.226471 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-849b6613-d243-40c4-a8e1-f8b7b28e14e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:49:59.227088 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-849b6613-d243-40c4-a8e1-f8b7b28e14e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:49:59.233008 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-849b6613-d243-40c4-a8e1-f8b7b28e14e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:59.233491 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-849b6613-d243-40c4-a8e1-f8b7b28e14e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:59.233924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-849b6613-d243-40c4-a8e1-f8b7b28e14e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:59.234608 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-849b6613-d243-40c4-a8e1-f8b7b28e14e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:49:59.235063 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-849b6613-d243-40c4-a8e1-f8b7b28e14e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:49:59.235494 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-849b6613-d243-40c4-a8e1-f8b7b28e14e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:49:59.367704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-849b6613-d243-40c4-a8e1-f8b7b28e14e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:49:59.375616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-849b6613-d243-40c4-a8e1-f8b7b28e14e1 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.153453 Aug 24 17:49:59.376186 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 133/252] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:49:59 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:00.030511 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-45315f1c-4e4d-4a7f-a6d6-0d14b4f92b2f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:00.031217 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-45315f1c-4e4d-4a7f-a6d6-0d14b4f92b2f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:00.040710 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-45315f1c-4e4d-4a7f-a6d6-0d14b4f92b2f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.041474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-45315f1c-4e4d-4a7f-a6d6-0d14b4f92b2f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.042152 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-45315f1c-4e4d-4a7f-a6d6-0d14b4f92b2f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.043305 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-45315f1c-4e4d-4a7f-a6d6-0d14b4f92b2f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.043750 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-45315f1c-4e4d-4a7f-a6d6-0d14b4f92b2f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.044303 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-45315f1c-4e4d-4a7f-a6d6-0d14b4f92b2f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.192607 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-45315f1c-4e4d-4a7f-a6d6-0d14b4f92b2f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:00.201522 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-45315f1c-4e4d-4a7f-a6d6-0d14b4f92b2f tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1504 microversion: 2.1 time: 0.174785 Aug 24 17:50:00.202195 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 120/253] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:00 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:00.399622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-47037be9-0f63-4ce4-88ce-31de54b66bb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:00.400905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-47037be9-0f63-4ce4-88ce-31de54b66bb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:00.415659 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-47037be9-0f63-4ce4-88ce-31de54b66bb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.415659 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-47037be9-0f63-4ce4-88ce-31de54b66bb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.415659 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-47037be9-0f63-4ce4-88ce-31de54b66bb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.415659 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-47037be9-0f63-4ce4-88ce-31de54b66bb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:00.416359 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-47037be9-0f63-4ce4-88ce-31de54b66bb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:00.416359 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-47037be9-0f63-4ce4-88ce-31de54b66bb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:00.552857 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-47037be9-0f63-4ce4-88ce-31de54b66bb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:00.560999 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-47037be9-0f63-4ce4-88ce-31de54b66bb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.167798 Aug 24 17:50:00.561552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 134/254] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:00 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:01.222758 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-24e96d54-62fe-47a3-bde4-d6b5d1f3bbc4 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:01.223291 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-24e96d54-62fe-47a3-bde4-d6b5d1f3bbc4 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:01.230267 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24e96d54-62fe-47a3-bde4-d6b5d1f3bbc4 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:01.230752 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24e96d54-62fe-47a3-bde4-d6b5d1f3bbc4 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:01.231185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24e96d54-62fe-47a3-bde4-d6b5d1f3bbc4 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:01.231905 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24e96d54-62fe-47a3-bde4-d6b5d1f3bbc4 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:01.232365 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24e96d54-62fe-47a3-bde4-d6b5d1f3bbc4 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:01.232789 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24e96d54-62fe-47a3-bde4-d6b5d1f3bbc4 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:01.366302 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-24e96d54-62fe-47a3-bde4-d6b5d1f3bbc4 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:01.374196 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-24e96d54-62fe-47a3-bde4-d6b5d1f3bbc4 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1504 microversion: 2.1 time: 0.155724 Aug 24 17:50:01.374759 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 121/255] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:01 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:01.577012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-334050766", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "networks": [{"uuid": "f9720aec-6384-45df-9a98-9c757a2487a4"}]}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:01.581922 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-268bfaea-d1e0-4105-8d7b-55ce4a721a1d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:01.582532 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-268bfaea-d1e0-4105-8d7b-55ce4a721a1d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:01.605838 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-268bfaea-d1e0-4105-8d7b-55ce4a721a1d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:01.606329 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-268bfaea-d1e0-4105-8d7b-55ce4a721a1d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:01.606760 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-268bfaea-d1e0-4105-8d7b-55ce4a721a1d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:01.607534 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-268bfaea-d1e0-4105-8d7b-55ce4a721a1d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:01.607938 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-268bfaea-d1e0-4105-8d7b-55ce4a721a1d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:01.608357 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-268bfaea-d1e0-4105-8d7b-55ce4a721a1d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:01.651947 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.network.neutron [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] validate_networks() for [('f9720aec-6384-45df-9a98-9c757a2487a4', None, None, None, None, None)] {{(pid=126994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:50:01.843004 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-268bfaea-d1e0-4105-8d7b-55ce4a721a1d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:01.853633 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-268bfaea-d1e0-4105-8d7b-55ce4a721a1d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.275355 Aug 24 17:50:01.854312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 122/256] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:01 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:02.124357 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Flavor limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:50:02.126357 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Image limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:50:02.127576 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Flavor pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:50:02.128300 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Image pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:50:02.129272 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:50:02.142245 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.142912 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.143800 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.144500 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.145110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.145680 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.168543 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Getting quotas for project b3b756a7bd444bf3aec562b2717f5623. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:50:02.172879 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Getting quotas for user 21fdd2fd30544e4e9e0bf184034106fa and project b3b756a7bd444bf3aec562b2717f5623. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:50:02.186655 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Going to run 1 instances... {{(pid=126994) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:50:02.189142 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:50:02.267620 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3ea05802-b94b-4244-975e-720a83fb2497 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699823 Aug 24 17:50:02.268372 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 135/257] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:50:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:50:02.281148 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1fe79d23-d643-4f25-b650-cec16fc309c8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:02.281691 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1fe79d23-d643-4f25-b650-cec16fc309c8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:02.397620 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-18051fec-c917-49c8-8562-76c34ca1a72d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:02.398263 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-18051fec-c917-49c8-8562-76c34ca1a72d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:02.402479 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1fe79d23-d643-4f25-b650-cec16fc309c8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:02.411604 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1fe79d23-d643-4f25-b650-cec16fc309c8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1218 microversion: 2.1 time: 0.135024 Aug 24 17:50:02.412187 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 123/258] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:02 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:02.423383 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-18051fec-c917-49c8-8562-76c34ca1a72d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.424142 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-18051fec-c917-49c8-8562-76c34ca1a72d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.425152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-18051fec-c917-49c8-8562-76c34ca1a72d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.426210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-18051fec-c917-49c8-8562-76c34ca1a72d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.426947 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-18051fec-c917-49c8-8562-76c34ca1a72d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.427450 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-18051fec-c917-49c8-8562-76c34ca1a72d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.605802 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-18051fec-c917-49c8-8562-76c34ca1a72d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:02.614318 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-18051fec-c917-49c8-8562-76c34ca1a72d tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1504 microversion: 2.1 time: 0.223922 Aug 24 17:50:02.621371 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 136/259] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:02 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:02.874071 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9e496934-ea2f-4b05-9b39-20d845221340 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:02.874754 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9e496934-ea2f-4b05-9b39-20d845221340 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:02.881259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9e496934-ea2f-4b05-9b39-20d845221340 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.881612 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9e496934-ea2f-4b05-9b39-20d845221340 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.882049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9e496934-ea2f-4b05-9b39-20d845221340 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:02.882740 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9e496934-ea2f-4b05-9b39-20d845221340 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:02.883189 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9e496934-ea2f-4b05-9b39-20d845221340 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:02.883651 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9e496934-ea2f-4b05-9b39-20d845221340 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.018860 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9e496934-ea2f-4b05-9b39-20d845221340 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:03.027129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9e496934-ea2f-4b05-9b39-20d845221340 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.156958 Aug 24 17:50:03.027724 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 124/260] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:02 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:03.433560 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-51492fca-27d8-4d5b-b132-34d5320568e8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:03.434135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-51492fca-27d8-4d5b-b132-34d5320568e8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:03.440102 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51492fca-27d8-4d5b-b132-34d5320568e8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.440587 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51492fca-27d8-4d5b-b132-34d5320568e8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.441024 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51492fca-27d8-4d5b-b132-34d5320568e8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.441712 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51492fca-27d8-4d5b-b132-34d5320568e8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.442167 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51492fca-27d8-4d5b-b132-34d5320568e8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.442610 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51492fca-27d8-4d5b-b132-34d5320568e8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.502182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-51492fca-27d8-4d5b-b132-34d5320568e8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:03.510111 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-51492fca-27d8-4d5b-b132-34d5320568e8 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1222 microversion: 2.1 time: 0.080617 Aug 24 17:50:03.510671 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 137/261] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:03 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:03.636760 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-63f713ac-d780-4fc9-9448-33cdfbb9983a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:03.637373 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-63f713ac-d780-4fc9-9448-33cdfbb9983a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:03.643938 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-63f713ac-d780-4fc9-9448-33cdfbb9983a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.644403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-63f713ac-d780-4fc9-9448-33cdfbb9983a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.644834 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-63f713ac-d780-4fc9-9448-33cdfbb9983a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.645518 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-63f713ac-d780-4fc9-9448-33cdfbb9983a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:03.645973 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-63f713ac-d780-4fc9-9448-33cdfbb9983a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:03.646390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-63f713ac-d780-4fc9-9448-33cdfbb9983a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:03.773967 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-63f713ac-d780-4fc9-9448-33cdfbb9983a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:03.783023 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-63f713ac-d780-4fc9-9448-33cdfbb9983a tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1504 microversion: 2.1 time: 0.150141 Aug 24 17:50:03.783610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 125/262] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:03 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:04.050226 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-31b56f80-4323-486b-8e04-dbe6445d778c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:04.050751 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-31b56f80-4323-486b-8e04-dbe6445d778c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:04.057326 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-31b56f80-4323-486b-8e04-dbe6445d778c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.057809 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-31b56f80-4323-486b-8e04-dbe6445d778c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.058238 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-31b56f80-4323-486b-8e04-dbe6445d778c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.058925 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-31b56f80-4323-486b-8e04-dbe6445d778c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.059375 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-31b56f80-4323-486b-8e04-dbe6445d778c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.059820 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-31b56f80-4323-486b-8e04-dbe6445d778c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.184136 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-31b56f80-4323-486b-8e04-dbe6445d778c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:04.191788 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-31b56f80-4323-486b-8e04-dbe6445d778c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.145440 Aug 24 17:50:04.192352 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 138/263] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:04 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:04.530993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0c75dc0c-9309-4948-b65f-e442b2c12ccd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:04.531636 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0c75dc0c-9309-4948-b65f-e442b2c12ccd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:04.538293 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0c75dc0c-9309-4948-b65f-e442b2c12ccd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.538775 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0c75dc0c-9309-4948-b65f-e442b2c12ccd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.539206 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0c75dc0c-9309-4948-b65f-e442b2c12ccd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.539930 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0c75dc0c-9309-4948-b65f-e442b2c12ccd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.540386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0c75dc0c-9309-4948-b65f-e442b2c12ccd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.540810 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0c75dc0c-9309-4948-b65f-e442b2c12ccd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.601398 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0c75dc0c-9309-4948-b65f-e442b2c12ccd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:04.609044 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0c75dc0c-9309-4948-b65f-e442b2c12ccd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1222 microversion: 2.1 time: 0.081953 Aug 24 17:50:04.609608 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 126/264] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:04 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:04.804660 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fb6829fb-6395-4eee-b856-10a3e108bc8e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:04.805303 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-fb6829fb-6395-4eee-b856-10a3e108bc8e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:04.811296 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fb6829fb-6395-4eee-b856-10a3e108bc8e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.811822 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fb6829fb-6395-4eee-b856-10a3e108bc8e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.812288 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fb6829fb-6395-4eee-b856-10a3e108bc8e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.813069 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fb6829fb-6395-4eee-b856-10a3e108bc8e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:04.813718 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fb6829fb-6395-4eee-b856-10a3e108bc8e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:04.814190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fb6829fb-6395-4eee-b856-10a3e108bc8e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:04.998782 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fb6829fb-6395-4eee-b856-10a3e108bc8e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:05.008649 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-fb6829fb-6395-4eee-b856-10a3e108bc8e tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1504 microversion: 2.1 time: 0.207829 Aug 24 17:50:05.009361 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 139/265] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:04 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:05.214867 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d06aae5a-5270-4dc9-97c7-347e58484627 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:05.215506 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d06aae5a-5270-4dc9-97c7-347e58484627 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:05.222302 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d06aae5a-5270-4dc9-97c7-347e58484627 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:05.222790 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d06aae5a-5270-4dc9-97c7-347e58484627 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:05.223242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d06aae5a-5270-4dc9-97c7-347e58484627 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.223976 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d06aae5a-5270-4dc9-97c7-347e58484627 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:05.224441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d06aae5a-5270-4dc9-97c7-347e58484627 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:05.224862 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d06aae5a-5270-4dc9-97c7-347e58484627 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.454128 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d06aae5a-5270-4dc9-97c7-347e58484627 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:05.474310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d06aae5a-5270-4dc9-97c7-347e58484627 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.265295 Aug 24 17:50:05.474904 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 127/266] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:05 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:05.630191 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-15c02218-454d-42c4-9df1-62810bb6986e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:05.631720 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-15c02218-454d-42c4-9df1-62810bb6986e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:05.644553 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-15c02218-454d-42c4-9df1-62810bb6986e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:05.645046 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-15c02218-454d-42c4-9df1-62810bb6986e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:05.651067 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-15c02218-454d-42c4-9df1-62810bb6986e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.652157 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-15c02218-454d-42c4-9df1-62810bb6986e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:05.652696 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-15c02218-454d-42c4-9df1-62810bb6986e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:05.653281 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-15c02218-454d-42c4-9df1-62810bb6986e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.780348 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-15c02218-454d-42c4-9df1-62810bb6986e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:05.784422 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:05.790926 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-15c02218-454d-42c4-9df1-62810bb6986e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1288 microversion: 2.1 time: 0.165272 Aug 24 17:50:05.796092 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 140/267] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:05 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1288 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:05.858657 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-bd1ddf33-f8a3-4b53-8c9d-c7ddb3eda312 req-ea09a552-6c69-4bcd-aad0-135405d26d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec10b81-73e5-43ff-ae13-ae07ceefc4d1", "name": "network-vif-deleted", "tag": "bc133561-95a4-45ac-99c4-226e108c6b87"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:05.871363 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-bd1ddf33-f8a3-4b53-8c9d-c7ddb3eda312 req-ea09a552-6c69-4bcd-aad0-135405d26d9e service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:05.871924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-bd1ddf33-f8a3-4b53-8c9d-c7ddb3eda312 req-ea09a552-6c69-4bcd-aad0-135405d26d9e service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:05.872559 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-bd1ddf33-f8a3-4b53-8c9d-c7ddb3eda312 req-ea09a552-6c69-4bcd-aad0-135405d26d9e service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:05.885089 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-bd1ddf33-f8a3-4b53-8c9d-c7ddb3eda312 req-ea09a552-6c69-4bcd-aad0-135405d26d9e service nova] Creating event network-vif-deleted:bc133561-95a4-45ac-99c4-226e108c6b87 for instance 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 on hv-cinder-84052 Aug 24 17:50:05.890529 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-bd1ddf33-f8a3-4b53-8c9d-c7ddb3eda312 req-ea09a552-6c69-4bcd-aad0-135405d26d9e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038065 Aug 24 17:50:05.891557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 128/268] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:06.030690 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9e17280f-3c24-4ff4-bff6-c3771ebd91e7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:06.031303 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9e17280f-3c24-4ff4-bff6-c3771ebd91e7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:06.057098 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e17280f-3c24-4ff4-bff6-c3771ebd91e7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:06.057712 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e17280f-3c24-4ff4-bff6-c3771ebd91e7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:06.058163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e17280f-3c24-4ff4-bff6-c3771ebd91e7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:06.060900 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e17280f-3c24-4ff4-bff6-c3771ebd91e7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:06.061373 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e17280f-3c24-4ff4-bff6-c3771ebd91e7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:06.064888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e17280f-3c24-4ff4-bff6-c3771ebd91e7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:06.215331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9e17280f-3c24-4ff4-bff6-c3771ebd91e7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aa761298e1f45e08fe4e42fba210d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f652ab66a4289be10048e1c8169d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:06.224448 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9e17280f-3c24-4ff4-bff6-c3771ebd91e7 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 200 len: 1299 microversion: 2.1 time: 0.198925 Aug 24 17:50:06.225567 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 141/269] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:06 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 1299 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:06.503295 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6511fec7-eee4-4df8-8443-d8ffa400294d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:06.504098 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6511fec7-eee4-4df8-8443-d8ffa400294d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:06.522171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6511fec7-eee4-4df8-8443-d8ffa400294d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:06.522171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6511fec7-eee4-4df8-8443-d8ffa400294d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:06.522171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6511fec7-eee4-4df8-8443-d8ffa400294d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:06.522171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6511fec7-eee4-4df8-8443-d8ffa400294d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:06.522547 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6511fec7-eee4-4df8-8443-d8ffa400294d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:06.522547 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6511fec7-eee4-4df8-8443-d8ffa400294d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:06.747792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6511fec7-eee4-4df8-8443-d8ffa400294d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:06.756735 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6511fec7-eee4-4df8-8443-d8ffa400294d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.260360 Aug 24 17:50:06.757232 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 129/270] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:06 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:06.813566 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a4dfc998-6e8e-4cea-8d6a-792834cc6217 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:06.814271 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a4dfc998-6e8e-4cea-8d6a-792834cc6217 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:06.822878 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a4dfc998-6e8e-4cea-8d6a-792834cc6217 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:06.826477 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a4dfc998-6e8e-4cea-8d6a-792834cc6217 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:06.827085 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a4dfc998-6e8e-4cea-8d6a-792834cc6217 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:06.827903 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a4dfc998-6e8e-4cea-8d6a-792834cc6217 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:06.828480 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a4dfc998-6e8e-4cea-8d6a-792834cc6217 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:06.829011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a4dfc998-6e8e-4cea-8d6a-792834cc6217 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:07.124095 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a4dfc998-6e8e-4cea-8d6a-792834cc6217 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:07.132741 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a4dfc998-6e8e-4cea-8d6a-792834cc6217 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1318 microversion: 2.1 time: 0.323204 Aug 24 17:50:07.133299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 142/271] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:06 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:07.246134 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-24af350e-f74e-44b3-82b7-d93bd37afad5 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:07.246965 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-24af350e-f74e-44b3-82b7-d93bd37afad5 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] [instance: 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:07.253929 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24af350e-f74e-44b3-82b7-d93bd37afad5 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:07.254659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24af350e-f74e-44b3-82b7-d93bd37afad5 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:07.255130 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24af350e-f74e-44b3-82b7-d93bd37afad5 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:07.255838 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24af350e-f74e-44b3-82b7-d93bd37afad5 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:07.256317 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24af350e-f74e-44b3-82b7-d93bd37afad5 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:07.256743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-24af350e-f74e-44b3-82b7-d93bd37afad5 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:07.270668 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-24af350e-f74e-44b3-82b7-d93bd37afad5 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] HTTP exception thrown: Instance 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 could not be found. Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-24af350e-f74e-44b3-82b7-d93bd37afad5 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Request method failure captured: Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 HTTP/1.1 Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmSUuSGfkrRZFjozbwA_0R56SFidVwscWu5ufs6AVv65lvTZZhlznpGPRwUQK1iTICi4d9mtAoLldVyBkVgQxTjUbz1VrTEtMmER76FiJVCR5hlsqMzt9Djk7FwejTC18CqDOT_YglOIC3MlGNPLjjRNTCRDYo-90OmtCt6Kha69lRY Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: f62f652ab66a4289be10048e1c8169d6 Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-VolumesActionsTest-969372950 Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:50:07.272441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:50:07.274142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f62f652ab66a4289be10048e1c8169d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62f652ab66a4289be10048e1c8169d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f62f652ab66a4289be10048e1c8169d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f62f652ab66a4289be10048e1c8169d6"}]}] Aug 24 17:50:07.274142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-VolumesActionsTest-969372950 Aug 24 17:50:07.274142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: f62f652ab66a4289be10048e1c8169d6 Aug 24 17:50:07.274142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-VolumesActionsTest-969372950 Aug 24 17:50:07.274142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-VolumesActionsTest-969372950-project Aug 24 17:50:07.274142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:50:07.274142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:50:07.274142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 4aa761298e1f45e08fe4e42fba210d2b Aug 24 17:50:07.274142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-VolumesActionsTest-969372950-project Aug 24 17:50:07.274142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:50:07.274142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 could not be found. Aug 24 17:50:07.274142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '6ec10b81-73e5-43ff-ae13-ae07ceefc4d1'} Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 could not be found. Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:07.275312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 could not be found. Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 could not be found. Aug 24 17:50:07.276709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:50:07.277809 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-24af350e-f74e-44b3-82b7-d93bd37afad5 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] Returning 404 to user: Instance 6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:07.277809 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-24af350e-f74e-44b3-82b7-d93bd37afad5 tempest-VolumesActionsTest-969372950 tempest-VolumesActionsTest-969372950-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1" status: 404 len: 111 microversion: 2.1 time: 0.031641 Aug 24 17:50:07.277809 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 130/272] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:07 2022] GET /compute/v2.1/servers/6ec10b81-73e5-43ff-ae13-ae07ceefc4d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:50:07.794256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a2fb8406-99f6-4e3b-8c93-022993270bcc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:07.796907 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a2fb8406-99f6-4e3b-8c93-022993270bcc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:07.803242 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:07.826739 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2fb8406-99f6-4e3b-8c93-022993270bcc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:07.829801 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2fb8406-99f6-4e3b-8c93-022993270bcc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:07.830418 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2fb8406-99f6-4e3b-8c93-022993270bcc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:07.831837 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2fb8406-99f6-4e3b-8c93-022993270bcc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:07.832607 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2fb8406-99f6-4e3b-8c93-022993270bcc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:07.833287 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2fb8406-99f6-4e3b-8c93-022993270bcc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:08.153757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2f7d60c3-034e-4227-a440-74200c3d2918 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:08.155757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2f7d60c3-034e-4227-a440-74200c3d2918 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:08.175066 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2f7d60c3-034e-4227-a440-74200c3d2918 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:08.175831 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2f7d60c3-034e-4227-a440-74200c3d2918 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:08.176451 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2f7d60c3-034e-4227-a440-74200c3d2918 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:08.177492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2f7d60c3-034e-4227-a440-74200c3d2918 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:08.178682 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2f7d60c3-034e-4227-a440-74200c3d2918 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:08.179283 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2f7d60c3-034e-4227-a440-74200c3d2918 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:08.271517 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a2fb8406-99f6-4e3b-8c93-022993270bcc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:08.299973 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a2fb8406-99f6-4e3b-8c93-022993270bcc tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.514676 Aug 24 17:50:08.300590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 143/273] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:07 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:08.436606 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2f7d60c3-034e-4227-a440-74200c3d2918 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:08.446319 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2f7d60c3-034e-4227-a440-74200c3d2918 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1318 microversion: 2.1 time: 0.296037 Aug 24 17:50:08.461444 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 131/274] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:08 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:08.544959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-212593ec-5937-40df-bf1f-2a62d07a735e req-2af4d737-7639-40a9-809c-9b51d3cac2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08638681-706c-45de-8b52-d9fb2559b56e", "tag": "bce29b41-eda3-4cc3-afba-8e72c0691c36"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:08.556468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-212593ec-5937-40df-bf1f-2a62d07a735e req-2af4d737-7639-40a9-809c-9b51d3cac2b7 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:08.557247 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-212593ec-5937-40df-bf1f-2a62d07a735e req-2af4d737-7639-40a9-809c-9b51d3cac2b7 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:08.557681 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-212593ec-5937-40df-bf1f-2a62d07a735e req-2af4d737-7639-40a9-809c-9b51d3cac2b7 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:08.571906 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-212593ec-5937-40df-bf1f-2a62d07a735e req-2af4d737-7639-40a9-809c-9b51d3cac2b7 service nova] Creating event network-changed:bce29b41-eda3-4cc3-afba-8e72c0691c36 for instance 08638681-706c-45de-8b52-d9fb2559b56e on hv-cinder-84052 Aug 24 17:50:08.579055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-212593ec-5937-40df-bf1f-2a62d07a735e req-2af4d737-7639-40a9-809c-9b51d3cac2b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038534 Aug 24 17:50:08.580057 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 144/275] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:09.322103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6e2cc469-46ee-4dab-bf88-bbeccadf9356 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:09.322804 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6e2cc469-46ee-4dab-bf88-bbeccadf9356 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:09.325295 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=62 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:09.331184 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6e2cc469-46ee-4dab-bf88-bbeccadf9356 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:09.331725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6e2cc469-46ee-4dab-bf88-bbeccadf9356 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:09.332160 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6e2cc469-46ee-4dab-bf88-bbeccadf9356 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:09.332854 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6e2cc469-46ee-4dab-bf88-bbeccadf9356 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:09.333312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6e2cc469-46ee-4dab-bf88-bbeccadf9356 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:09.333812 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6e2cc469-46ee-4dab-bf88-bbeccadf9356 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:09.468711 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-737dc51e-d224-4bb8-80a6-c0a7bc124b70 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:09.469413 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-737dc51e-d224-4bb8-80a6-c0a7bc124b70 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:09.476432 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-737dc51e-d224-4bb8-80a6-c0a7bc124b70 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:09.476432 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-737dc51e-d224-4bb8-80a6-c0a7bc124b70 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:09.476801 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-737dc51e-d224-4bb8-80a6-c0a7bc124b70 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:09.477509 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-737dc51e-d224-4bb8-80a6-c0a7bc124b70 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:09.477961 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-737dc51e-d224-4bb8-80a6-c0a7bc124b70 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:09.478754 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-737dc51e-d224-4bb8-80a6-c0a7bc124b70 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:09.484939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6e2cc469-46ee-4dab-bf88-bbeccadf9356 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:09.492959 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6e2cc469-46ee-4dab-bf88-bbeccadf9356 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.175191 Aug 24 17:50:09.493527 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 132/276] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:09 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:09.653634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-737dc51e-d224-4bb8-80a6-c0a7bc124b70 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:09.661129 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-737dc51e-d224-4bb8-80a6-c0a7bc124b70 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1318 microversion: 2.1 time: 0.197270 Aug 24 17:50:09.661772 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 145/277] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:09 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:10.514292 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1f472154-a632-49ad-9f30-5dc6169af61b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:10.515061 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1f472154-a632-49ad-9f30-5dc6169af61b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:10.522757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1f472154-a632-49ad-9f30-5dc6169af61b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:10.523251 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1f472154-a632-49ad-9f30-5dc6169af61b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:10.523720 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1f472154-a632-49ad-9f30-5dc6169af61b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:10.524421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1f472154-a632-49ad-9f30-5dc6169af61b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:10.524876 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1f472154-a632-49ad-9f30-5dc6169af61b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:10.525297 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1f472154-a632-49ad-9f30-5dc6169af61b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:10.666833 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1f472154-a632-49ad-9f30-5dc6169af61b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:10.675673 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1f472154-a632-49ad-9f30-5dc6169af61b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.165192 Aug 24 17:50:10.678154 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 133/278] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:10 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:10.681383 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-98b93892-98fe-4099-a766-9072344adf36 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:10.682004 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-98b93892-98fe-4099-a766-9072344adf36 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:10.690968 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98b93892-98fe-4099-a766-9072344adf36 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:10.691508 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98b93892-98fe-4099-a766-9072344adf36 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:10.691924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98b93892-98fe-4099-a766-9072344adf36 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:10.692626 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98b93892-98fe-4099-a766-9072344adf36 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:10.693085 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98b93892-98fe-4099-a766-9072344adf36 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:10.693624 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98b93892-98fe-4099-a766-9072344adf36 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:10.824110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-98b93892-98fe-4099-a766-9072344adf36 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:10.831896 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-98b93892-98fe-4099-a766-9072344adf36 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1318 microversion: 2.1 time: 0.154397 Aug 24 17:50:10.832466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 146/279] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:10 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:11.701265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-939c12ac-9f2c-44a6-acb1-f0ce82beb477 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:11.701870 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-939c12ac-9f2c-44a6-acb1-f0ce82beb477 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:11.708750 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-939c12ac-9f2c-44a6-acb1-f0ce82beb477 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:11.709261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-939c12ac-9f2c-44a6-acb1-f0ce82beb477 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:11.709699 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-939c12ac-9f2c-44a6-acb1-f0ce82beb477 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:11.710402 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-939c12ac-9f2c-44a6-acb1-f0ce82beb477 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:11.710865 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-939c12ac-9f2c-44a6-acb1-f0ce82beb477 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:11.711347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-939c12ac-9f2c-44a6-acb1-f0ce82beb477 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:11.854236 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ba8e353d-c344-450c-aae8-e07758bbaa89 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:11.854961 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ba8e353d-c344-450c-aae8-e07758bbaa89 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:11.856728 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-939c12ac-9f2c-44a6-acb1-f0ce82beb477 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:11.863506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ba8e353d-c344-450c-aae8-e07758bbaa89 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:11.864201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ba8e353d-c344-450c-aae8-e07758bbaa89 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:11.864840 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ba8e353d-c344-450c-aae8-e07758bbaa89 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:11.866106 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ba8e353d-c344-450c-aae8-e07758bbaa89 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:11.866624 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ba8e353d-c344-450c-aae8-e07758bbaa89 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:11.867014 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ba8e353d-c344-450c-aae8-e07758bbaa89 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:11.868803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-939c12ac-9f2c-44a6-acb1-f0ce82beb477 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.171054 Aug 24 17:50:11.869469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 134/280] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:11 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:12.019132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ba8e353d-c344-450c-aae8-e07758bbaa89 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:12.028099 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ba8e353d-c344-450c-aae8-e07758bbaa89 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1318 microversion: 2.1 time: 0.178790 Aug 24 17:50:12.028767 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 147/281] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:11 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:12.890608 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ac3ad383-7020-4ba0-967f-ccf88a3b0186 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:12.891531 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ac3ad383-7020-4ba0-967f-ccf88a3b0186 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:12.893705 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:12.899719 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ac3ad383-7020-4ba0-967f-ccf88a3b0186 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:12.900212 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ac3ad383-7020-4ba0-967f-ccf88a3b0186 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:12.900648 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ac3ad383-7020-4ba0-967f-ccf88a3b0186 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:12.901623 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ac3ad383-7020-4ba0-967f-ccf88a3b0186 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:12.902092 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ac3ad383-7020-4ba0-967f-ccf88a3b0186 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:12.902517 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ac3ad383-7020-4ba0-967f-ccf88a3b0186 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:12.907656 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=100 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:13.051254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a083cdd4-5529-41c8-ba63-a4727d6db771 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:13.054116 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a083cdd4-5529-41c8-ba63-a4727d6db771 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:13.056705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:13.058021 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=6 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:13.069797 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ac3ad383-7020-4ba0-967f-ccf88a3b0186 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:13.076053 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a083cdd4-5529-41c8-ba63-a4727d6db771 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:13.076861 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a083cdd4-5529-41c8-ba63-a4727d6db771 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:13.077532 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a083cdd4-5529-41c8-ba63-a4727d6db771 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:13.078500 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a083cdd4-5529-41c8-ba63-a4727d6db771 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:13.079960 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a083cdd4-5529-41c8-ba63-a4727d6db771 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:13.082305 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a083cdd4-5529-41c8-ba63-a4727d6db771 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:13.083434 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ac3ad383-7020-4ba0-967f-ccf88a3b0186 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.196993 Aug 24 17:50:13.099817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 135/282] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:12 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:13.213012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e74e6cef-1099-433c-a5b3-f9b77af46d4b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:13.213444 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e74e6cef-1099-433c-a5b3-f9b77af46d4b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:13.220657 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e74e6cef-1099-433c-a5b3-f9b77af46d4b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:13.221413 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e74e6cef-1099-433c-a5b3-f9b77af46d4b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:13.222318 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e74e6cef-1099-433c-a5b3-f9b77af46d4b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:13.223236 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e74e6cef-1099-433c-a5b3-f9b77af46d4b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:13.223957 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e74e6cef-1099-433c-a5b3-f9b77af46d4b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:13.228620 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e74e6cef-1099-433c-a5b3-f9b77af46d4b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:13.275282 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e74e6cef-1099-433c-a5b3-f9b77af46d4b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/ips" status: 200 len: 150 microversion: 2.20 time: 0.066107 Aug 24 17:50:13.275903 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 136/283] 10.222.0.27 () {60 vars in 1289 bytes} [Wed Aug 24 17:50:13 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/ips => generated 150 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 17:50:13.289503 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a083cdd4-5529-41c8-ba63-a4727d6db771 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:13.298317 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a083cdd4-5529-41c8-ba63-a4727d6db771 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1318 microversion: 2.1 time: 0.251662 Aug 24 17:50:13.298894 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 148/284] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:13 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:14.106066 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5898e9f7-8ef4-4109-a462-034b7e395a41 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:14.106680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5898e9f7-8ef4-4109-a462-034b7e395a41 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:14.117163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5898e9f7-8ef4-4109-a462-034b7e395a41 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:14.121780 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5898e9f7-8ef4-4109-a462-034b7e395a41 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:14.122468 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5898e9f7-8ef4-4109-a462-034b7e395a41 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:14.123743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5898e9f7-8ef4-4109-a462-034b7e395a41 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:14.124371 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5898e9f7-8ef4-4109-a462-034b7e395a41 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:14.128213 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5898e9f7-8ef4-4109-a462-034b7e395a41 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:14.320513 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-229ffb01-82c5-423b-937a-fc5d0e0d2d55 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:14.322097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-229ffb01-82c5-423b-937a-fc5d0e0d2d55 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:14.335454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-229ffb01-82c5-423b-937a-fc5d0e0d2d55 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:14.340265 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-229ffb01-82c5-423b-937a-fc5d0e0d2d55 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:14.341297 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-229ffb01-82c5-423b-937a-fc5d0e0d2d55 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:14.342281 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-229ffb01-82c5-423b-937a-fc5d0e0d2d55 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:14.347265 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-229ffb01-82c5-423b-937a-fc5d0e0d2d55 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:14.348056 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-229ffb01-82c5-423b-937a-fc5d0e0d2d55 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:14.654130 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-5898e9f7-8ef4-4109-a462-034b7e395a41 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:14.664363 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5898e9f7-8ef4-4109-a462-034b7e395a41 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.562067 Aug 24 17:50:14.665377 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 137/285] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:14 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:14.796752 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-229ffb01-82c5-423b-937a-fc5d0e0d2d55 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:14.807679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-229ffb01-82c5-423b-937a-fc5d0e0d2d55 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1318 microversion: 2.1 time: 0.490224 Aug 24 17:50:14.808383 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 149/286] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:14 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:15.689367 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-030f261c-f428-4915-bfca-3052df0791ae tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:15.690793 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-030f261c-f428-4915-bfca-3052df0791ae tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:15.720175 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-030f261c-f428-4915-bfca-3052df0791ae tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:15.721534 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-030f261c-f428-4915-bfca-3052df0791ae tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:15.727004 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-030f261c-f428-4915-bfca-3052df0791ae tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:15.728898 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-030f261c-f428-4915-bfca-3052df0791ae tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:15.731610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-030f261c-f428-4915-bfca-3052df0791ae tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:15.733063 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-030f261c-f428-4915-bfca-3052df0791ae tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:15.832712 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-25e27cbe-3ac9-4c51-9cab-87116ee123db tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:15.833435 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-25e27cbe-3ac9-4c51-9cab-87116ee123db tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:15.839529 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-25e27cbe-3ac9-4c51-9cab-87116ee123db tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:15.840000 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-25e27cbe-3ac9-4c51-9cab-87116ee123db tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:15.840431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-25e27cbe-3ac9-4c51-9cab-87116ee123db tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:15.841384 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-25e27cbe-3ac9-4c51-9cab-87116ee123db tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:15.841833 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-25e27cbe-3ac9-4c51-9cab-87116ee123db tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:15.852884 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-25e27cbe-3ac9-4c51-9cab-87116ee123db tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:16.020065 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-030f261c-f428-4915-bfca-3052df0791ae tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:16.034937 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-030f261c-f428-4915-bfca-3052df0791ae tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1502 microversion: 2.1 time: 0.349364 Aug 24 17:50:16.038286 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 138/287] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:15 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1502 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:16.050211 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-3ce09029-7936-403f-8a9f-98a12eb31ef8 req-36c3a078-cf69-4d5d-ac05-22755aa214b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08638681-706c-45de-8b52-d9fb2559b56e", "name": "network-vif-plugged", "status": "completed", "tag": "bce29b41-eda3-4cc3-afba-8e72c0691c36"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:16.082600 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-3ce09029-7936-403f-8a9f-98a12eb31ef8 req-36c3a078-cf69-4d5d-ac05-22755aa214b9 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.083086 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-3ce09029-7936-403f-8a9f-98a12eb31ef8 req-36c3a078-cf69-4d5d-ac05-22755aa214b9 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.083534 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-3ce09029-7936-403f-8a9f-98a12eb31ef8 req-36c3a078-cf69-4d5d-ac05-22755aa214b9 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:16.127443 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-3ce09029-7936-403f-8a9f-98a12eb31ef8 req-36c3a078-cf69-4d5d-ac05-22755aa214b9 service nova] Creating event network-vif-plugged:bce29b41-eda3-4cc3-afba-8e72c0691c36 for instance 08638681-706c-45de-8b52-d9fb2559b56e on hv-cinder-84052 Aug 24 17:50:16.142426 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-3ce09029-7936-403f-8a9f-98a12eb31ef8 req-36c3a078-cf69-4d5d-ac05-22755aa214b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100281 Aug 24 17:50:16.146393 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 139/288] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:16.156151 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-91870500-c3ca-49f1-9f3a-2226fbd9d744 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "627a9877-4be2-4f2a-a32f-48a7f4ac40ea"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:16.161063 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-91870500-c3ca-49f1-9f3a-2226fbd9d744 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:16.171307 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-91870500-c3ca-49f1-9f3a-2226fbd9d744 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.172103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-91870500-c3ca-49f1-9f3a-2226fbd9d744 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.172920 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-91870500-c3ca-49f1-9f3a-2226fbd9d744 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:16.174020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-91870500-c3ca-49f1-9f3a-2226fbd9d744 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.174632 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-91870500-c3ca-49f1-9f3a-2226fbd9d744 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.175209 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-91870500-c3ca-49f1-9f3a-2226fbd9d744 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:16.182582 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-25e27cbe-3ac9-4c51-9cab-87116ee123db tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:16.192792 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-25e27cbe-3ac9-4c51-9cab-87116ee123db tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1318 microversion: 2.1 time: 0.363974 Aug 24 17:50:16.203511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 150/289] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:15 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:16.214083 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-91870500-c3ca-49f1-9f3a-2226fbd9d744 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] HTTP exception thrown: Cannot 'attach_volume' instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 while it is in vm_state rescued Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-91870500-c3ca-49f1-9f3a-2226fbd9d744 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Request method failure captured: Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: POST /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48/os-volume_attachments HTTP/1.1 Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 74 Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmRXXSo9jllcBh3muzG85q1balMF-atjt1OIcAyxcjw16hc-GKcl2STFaNuxKTBDjXoLg9uWGhPWb1tYXoxnNn1OLjyOjPO8b_l3i-5sX-s3w4NWOcztytI1Id99vRg8qfxhsCxnCb1ylUJJIWsQ8B0GF2Xv2njFbtGFkpHPXQPeznc Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 0fb78a439e20439f8d93a4f7df3f28f8 Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:50:16.216324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:50:16.217924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fb78a439e20439f8d93a4f7df3f28f8"}]}] Aug 24 17:50:16.217924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:50:16.217924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 0fb78a439e20439f8d93a4f7df3f28f8 Aug 24 17:50:16.217924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:50:16.217924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-ServerRescueNegativeTestJSON-1642173346-project Aug 24 17:50:16.217924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:50:16.217924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:50:16.217924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 7d3139d9e58f4b56a370661e2a5d4e5e Aug 24 17:50:16.217924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1642173346-project Aug 24 17:50:16.217924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Aug 24 17:50:16.217924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {"volumeAttachment": {"volumeId": "627a9877-4be2-4f2a-a32f-48a7f4ac40ea"}} Aug 24 17:50:16.217924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Cannot 'attach_volume' instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 while it is in vm_state rescued Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'server_id': '0397fbeb-25d8-46af-98bb-8a7b70c97f48', 'body': {'volumeAttachment': {'volumeId': '627a9877-4be2-4f2a-a32f-48a7f4ac40ea'}}} Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:50:16.218979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 while it is in vm_state rescued Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:50:16.220824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:50:16.222956 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:50:16.222956 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:50:16.222956 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 while it is in vm_state rescued Aug 24 17:50:16.222956 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:50:16.233632 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-91870500-c3ca-49f1-9f3a-2226fbd9d744 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Returning 409 to user: Cannot 'attach_volume' instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 while it is in vm_state rescued {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:50:16.233632 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-91870500-c3ca-49f1-9f3a-2226fbd9d744 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "POST /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074058 Aug 24 17:50:16.233632 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 140/290] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:50:16 2022] POST /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48/os-volume_attachments => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 17:50:16.235242 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c1bbc211-cc30-4739-bc92-baa241b137c3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:16.235943 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c1bbc211-cc30-4739-bc92-baa241b137c3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:16.256629 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c1bbc211-cc30-4739-bc92-baa241b137c3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.261119 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c1bbc211-cc30-4739-bc92-baa241b137c3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.261594 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c1bbc211-cc30-4739-bc92-baa241b137c3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:16.262433 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c1bbc211-cc30-4739-bc92-baa241b137c3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.263105 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c1bbc211-cc30-4739-bc92-baa241b137c3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.263566 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c1bbc211-cc30-4739-bc92-baa241b137c3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:16.379362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0b8347c6-97ac-41e5-9ba9-8ea9681f44e0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:16.379847 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0b8347c6-97ac-41e5-9ba9-8ea9681f44e0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:16.397908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0b8347c6-97ac-41e5-9ba9-8ea9681f44e0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.398730 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0b8347c6-97ac-41e5-9ba9-8ea9681f44e0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.399268 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0b8347c6-97ac-41e5-9ba9-8ea9681f44e0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:16.401162 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0b8347c6-97ac-41e5-9ba9-8ea9681f44e0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.401935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0b8347c6-97ac-41e5-9ba9-8ea9681f44e0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.402594 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0b8347c6-97ac-41e5-9ba9-8ea9681f44e0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:16.436577 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-0b8347c6-97ac-41e5-9ba9-8ea9681f44e0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lazy-loading 'flavor' on Instance uuid 11705238-e9d4-4c1e-ab49-d5a27eb4df4c {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:50:16.449404 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c1bbc211-cc30-4739-bc92-baa241b137c3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "POST /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48/action" status: 202 len: 0 microversion: 2.1 time: 0.215698 Aug 24 17:50:16.451041 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 151/291] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:50:16 2022] POST /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:50:16.468593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f00ddac5-5282-4d72-b9fe-abe15e224fb2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:16.471433 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f00ddac5-5282-4d72-b9fe-abe15e224fb2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:16.493541 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f00ddac5-5282-4d72-b9fe-abe15e224fb2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.495592 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f00ddac5-5282-4d72-b9fe-abe15e224fb2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.496507 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f00ddac5-5282-4d72-b9fe-abe15e224fb2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:16.497970 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f00ddac5-5282-4d72-b9fe-abe15e224fb2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.500262 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f00ddac5-5282-4d72-b9fe-abe15e224fb2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.501694 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f00ddac5-5282-4d72-b9fe-abe15e224fb2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:16.820422 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f00ddac5-5282-4d72-b9fe-abe15e224fb2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:16.834816 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f00ddac5-5282-4d72-b9fe-abe15e224fb2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1510 microversion: 2.1 time: 0.377311 Aug 24 17:50:16.838056 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 152/292] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:16 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1510 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:16.873774 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0b8347c6-97ac-41e5-9ba9-8ea9681f44e0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "POST /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/action" status: 202 len: 0 microversion: 2.20 time: 0.502694 Aug 24 17:50:16.878125 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 141/293] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Aug 24 17:50:16 2022] POST /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:50:16.887557 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-10593a5a-6671-4498-a3c6-929b91c6967a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:16.888607 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-10593a5a-6671-4498-a3c6-929b91c6967a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:16.900305 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10593a5a-6671-4498-a3c6-929b91c6967a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.901827 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10593a5a-6671-4498-a3c6-929b91c6967a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.902923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10593a5a-6671-4498-a3c6-929b91c6967a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:16.906594 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10593a5a-6671-4498-a3c6-929b91c6967a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:16.909076 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10593a5a-6671-4498-a3c6-929b91c6967a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:16.912014 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10593a5a-6671-4498-a3c6-929b91c6967a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:17.219696 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d728a6a8-2d14-496c-aa98-b1f5885bcad9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:17.220897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d728a6a8-2d14-496c-aa98-b1f5885bcad9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:17.239941 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d728a6a8-2d14-496c-aa98-b1f5885bcad9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:17.247788 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d728a6a8-2d14-496c-aa98-b1f5885bcad9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:17.248237 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d728a6a8-2d14-496c-aa98-b1f5885bcad9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:17.248969 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d728a6a8-2d14-496c-aa98-b1f5885bcad9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:17.249493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d728a6a8-2d14-496c-aa98-b1f5885bcad9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:17.249837 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d728a6a8-2d14-496c-aa98-b1f5885bcad9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:17.321039 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-10593a5a-6671-4498-a3c6-929b91c6967a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:17.336542 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-10593a5a-6671-4498-a3c6-929b91c6967a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:17.339571 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-10593a5a-6671-4498-a3c6-929b91c6967a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:17.341806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-10593a5a-6671-4498-a3c6-929b91c6967a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.457834 Aug 24 17:50:17.346480 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 153/294] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:16 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:17.493295 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d728a6a8-2d14-496c-aa98-b1f5885bcad9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:17.502132 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d728a6a8-2d14-496c-aa98-b1f5885bcad9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1318 microversion: 2.1 time: 0.287198 Aug 24 17:50:17.503182 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 142/295] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:17 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:17.873900 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6b344dfa-d325-47e6-ad48-a095cb735302 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:17.879282 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-6b344dfa-d325-47e6-ad48-a095cb735302 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:17.897167 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b344dfa-d325-47e6-ad48-a095cb735302 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:17.904747 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b344dfa-d325-47e6-ad48-a095cb735302 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:17.905989 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b344dfa-d325-47e6-ad48-a095cb735302 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:17.907312 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b344dfa-d325-47e6-ad48-a095cb735302 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:17.917626 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b344dfa-d325-47e6-ad48-a095cb735302 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:17.935591 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b344dfa-d325-47e6-ad48-a095cb735302 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:18.228653 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6b344dfa-d325-47e6-ad48-a095cb735302 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:18.240038 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6b344dfa-d325-47e6-ad48-a095cb735302 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1510 microversion: 2.1 time: 0.372367 Aug 24 17:50:18.251031 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 154/296] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:17 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:18.370081 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0a4541ea-4fe5-41a5-9421-9653304eba34 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:18.370693 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0a4541ea-4fe5-41a5-9421-9653304eba34 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:18.378190 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0a4541ea-4fe5-41a5-9421-9653304eba34 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:18.378671 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0a4541ea-4fe5-41a5-9421-9653304eba34 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:18.379097 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0a4541ea-4fe5-41a5-9421-9653304eba34 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:18.379816 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0a4541ea-4fe5-41a5-9421-9653304eba34 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:18.380264 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0a4541ea-4fe5-41a5-9421-9653304eba34 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:18.380678 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0a4541ea-4fe5-41a5-9421-9653304eba34 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:18.525667 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f50032ea-74bf-40c9-a7b1-e8a4bcabd471 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:18.526469 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f50032ea-74bf-40c9-a7b1-e8a4bcabd471 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:18.541779 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f50032ea-74bf-40c9-a7b1-e8a4bcabd471 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:18.542666 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f50032ea-74bf-40c9-a7b1-e8a4bcabd471 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:18.544468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f50032ea-74bf-40c9-a7b1-e8a4bcabd471 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:18.546750 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f50032ea-74bf-40c9-a7b1-e8a4bcabd471 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:18.547803 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f50032ea-74bf-40c9-a7b1-e8a4bcabd471 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:18.548722 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f50032ea-74bf-40c9-a7b1-e8a4bcabd471 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:18.807948 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0a4541ea-4fe5-41a5-9421-9653304eba34 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:18.820742 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0a4541ea-4fe5-41a5-9421-9653304eba34 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:18.824855 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0a4541ea-4fe5-41a5-9421-9653304eba34 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:18.826935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0a4541ea-4fe5-41a5-9421-9653304eba34 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.460880 Aug 24 17:50:18.827953 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 143/297] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:18 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:50:18.861682 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f50032ea-74bf-40c9-a7b1-e8a4bcabd471 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:18.873112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f50032ea-74bf-40c9-a7b1-e8a4bcabd471 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1318 microversion: 2.1 time: 0.352583 Aug 24 17:50:18.887612 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 155/298] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:18 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:19.264190 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e2c7d5c6-30a6-4dc4-8931-26ed34f75f87 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:19.265099 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e2c7d5c6-30a6-4dc4-8931-26ed34f75f87 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:19.272380 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e2c7d5c6-30a6-4dc4-8931-26ed34f75f87 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:19.272877 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e2c7d5c6-30a6-4dc4-8931-26ed34f75f87 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:19.273325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e2c7d5c6-30a6-4dc4-8931-26ed34f75f87 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:19.274030 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e2c7d5c6-30a6-4dc4-8931-26ed34f75f87 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:19.274489 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e2c7d5c6-30a6-4dc4-8931-26ed34f75f87 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:19.274915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e2c7d5c6-30a6-4dc4-8931-26ed34f75f87 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:19.440793 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e2c7d5c6-30a6-4dc4-8931-26ed34f75f87 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:19.451326 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e2c7d5c6-30a6-4dc4-8931-26ed34f75f87 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1510 microversion: 2.1 time: 0.195347 Aug 24 17:50:19.453339 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 144/299] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:19 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:19.857001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-86c58581-6484-4994-91f5-94a44cad9304 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:19.857956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-86c58581-6484-4994-91f5-94a44cad9304 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:19.866680 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-86c58581-6484-4994-91f5-94a44cad9304 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:19.867424 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-86c58581-6484-4994-91f5-94a44cad9304 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:19.868092 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-86c58581-6484-4994-91f5-94a44cad9304 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:19.869250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-86c58581-6484-4994-91f5-94a44cad9304 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:19.870712 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-86c58581-6484-4994-91f5-94a44cad9304 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:19.872635 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-86c58581-6484-4994-91f5-94a44cad9304 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:19.894593 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-27926009-fbce-419c-be92-8995f6d61236 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:19.896242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-27926009-fbce-419c-be92-8995f6d61236 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:19.906921 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-27926009-fbce-419c-be92-8995f6d61236 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:19.910631 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-27926009-fbce-419c-be92-8995f6d61236 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:19.911120 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-27926009-fbce-419c-be92-8995f6d61236 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:19.911886 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-27926009-fbce-419c-be92-8995f6d61236 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:19.912884 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-27926009-fbce-419c-be92-8995f6d61236 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:19.913309 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-27926009-fbce-419c-be92-8995f6d61236 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:20.091624 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-86c58581-6484-4994-91f5-94a44cad9304 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:20.104047 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-86c58581-6484-4994-91f5-94a44cad9304 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:20.105826 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-86c58581-6484-4994-91f5-94a44cad9304 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:20.107149 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-86c58581-6484-4994-91f5-94a44cad9304 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.254586 Aug 24 17:50:20.107990 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 156/300] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:19 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:20.170345 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-27926009-fbce-419c-be92-8995f6d61236 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:20.180502 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-27926009-fbce-419c-be92-8995f6d61236 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1507 microversion: 2.1 time: 0.289980 Aug 24 17:50:20.191520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 145/301] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:19 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:20.476925 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-2a004cd8-982a-4da8-bf00-59a02dcbbbb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:20.479119 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-2a004cd8-982a-4da8-bf00-59a02dcbbbb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:20.485599 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2a004cd8-982a-4da8-bf00-59a02dcbbbb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:20.486619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2a004cd8-982a-4da8-bf00-59a02dcbbbb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:20.487244 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2a004cd8-982a-4da8-bf00-59a02dcbbbb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:20.488144 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2a004cd8-982a-4da8-bf00-59a02dcbbbb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:20.488759 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2a004cd8-982a-4da8-bf00-59a02dcbbbb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:20.489349 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2a004cd8-982a-4da8-bf00-59a02dcbbbb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:20.495119 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:20.792348 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-2a004cd8-982a-4da8-bf00-59a02dcbbbb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:20.804064 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-2a004cd8-982a-4da8-bf00-59a02dcbbbb0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1510 microversion: 2.1 time: 0.331398 Aug 24 17:50:20.804696 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 157/302] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:20 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1510 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:21.133564 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c5fe90a8-f428-454b-9b02-262769066e55 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:21.134107 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c5fe90a8-f428-454b-9b02-262769066e55 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:21.140558 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c5fe90a8-f428-454b-9b02-262769066e55 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:21.141039 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c5fe90a8-f428-454b-9b02-262769066e55 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:21.141476 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c5fe90a8-f428-454b-9b02-262769066e55 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:21.142187 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c5fe90a8-f428-454b-9b02-262769066e55 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:21.142639 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c5fe90a8-f428-454b-9b02-262769066e55 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:21.143064 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c5fe90a8-f428-454b-9b02-262769066e55 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:21.276678 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c5fe90a8-f428-454b-9b02-262769066e55 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:21.284792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c5fe90a8-f428-454b-9b02-262769066e55 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:21.286293 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c5fe90a8-f428-454b-9b02-262769066e55 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:21.288252 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c5fe90a8-f428-454b-9b02-262769066e55 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.158221 Aug 24 17:50:21.288798 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 146/303] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:21 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:21.828127 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c68a2530-8002-49df-92a8-5d145e2969a6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:21.829020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c68a2530-8002-49df-92a8-5d145e2969a6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:21.835319 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c68a2530-8002-49df-92a8-5d145e2969a6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:21.835834 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c68a2530-8002-49df-92a8-5d145e2969a6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:21.836271 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c68a2530-8002-49df-92a8-5d145e2969a6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:21.836960 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c68a2530-8002-49df-92a8-5d145e2969a6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:21.837409 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c68a2530-8002-49df-92a8-5d145e2969a6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:21.837826 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c68a2530-8002-49df-92a8-5d145e2969a6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:21.970631 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c68a2530-8002-49df-92a8-5d145e2969a6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:21.978170 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c68a2530-8002-49df-92a8-5d145e2969a6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1510 microversion: 2.1 time: 0.153840 Aug 24 17:50:21.978722 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 158/304] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:21 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:22.310173 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-dcd2f53d-7a3c-476f-82f0-04b1f13a442a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:22.310786 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-dcd2f53d-7a3c-476f-82f0-04b1f13a442a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:22.317219 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dcd2f53d-7a3c-476f-82f0-04b1f13a442a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:22.317700 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dcd2f53d-7a3c-476f-82f0-04b1f13a442a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:22.318167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dcd2f53d-7a3c-476f-82f0-04b1f13a442a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:22.319424 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dcd2f53d-7a3c-476f-82f0-04b1f13a442a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:22.319903 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dcd2f53d-7a3c-476f-82f0-04b1f13a442a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:22.320324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dcd2f53d-7a3c-476f-82f0-04b1f13a442a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:22.446356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-dcd2f53d-7a3c-476f-82f0-04b1f13a442a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:22.455099 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-dcd2f53d-7a3c-476f-82f0-04b1f13a442a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:22.456644 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-dcd2f53d-7a3c-476f-82f0-04b1f13a442a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:22.457793 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-dcd2f53d-7a3c-476f-82f0-04b1f13a442a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.151511 Aug 24 17:50:22.458341 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 147/305] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:22 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:22.998157 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8fdea3e7-d0e6-4e1a-b873-42ec5d058a5b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:22.998766 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8fdea3e7-d0e6-4e1a-b873-42ec5d058a5b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:23.004653 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8fdea3e7-d0e6-4e1a-b873-42ec5d058a5b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:23.005141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8fdea3e7-d0e6-4e1a-b873-42ec5d058a5b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:23.005583 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8fdea3e7-d0e6-4e1a-b873-42ec5d058a5b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:23.006770 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8fdea3e7-d0e6-4e1a-b873-42ec5d058a5b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:23.007233 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8fdea3e7-d0e6-4e1a-b873-42ec5d058a5b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:23.007698 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8fdea3e7-d0e6-4e1a-b873-42ec5d058a5b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:23.135150 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8fdea3e7-d0e6-4e1a-b873-42ec5d058a5b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:23.142782 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8fdea3e7-d0e6-4e1a-b873-42ec5d058a5b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1510 microversion: 2.1 time: 0.148478 Aug 24 17:50:23.143334 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 159/306] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:22 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:23.481356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8d0b0675-e307-4e96-9820-119b64fb5a5e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:23.481947 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8d0b0675-e307-4e96-9820-119b64fb5a5e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:23.489334 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8d0b0675-e307-4e96-9820-119b64fb5a5e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:23.489810 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8d0b0675-e307-4e96-9820-119b64fb5a5e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:23.490881 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8d0b0675-e307-4e96-9820-119b64fb5a5e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:23.491596 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8d0b0675-e307-4e96-9820-119b64fb5a5e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:23.492046 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8d0b0675-e307-4e96-9820-119b64fb5a5e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:23.493016 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8d0b0675-e307-4e96-9820-119b64fb5a5e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:23.629421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8d0b0675-e307-4e96-9820-119b64fb5a5e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:23.643016 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8d0b0675-e307-4e96-9820-119b64fb5a5e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:23.644991 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8d0b0675-e307-4e96-9820-119b64fb5a5e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:23.646423 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8d0b0675-e307-4e96-9820-119b64fb5a5e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.169051 Aug 24 17:50:23.647220 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 148/307] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:23 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:24.164390 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-04dc22bb-7b52-452d-bc3d-2be25f7084a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:24.165631 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-04dc22bb-7b52-452d-bc3d-2be25f7084a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:24.171733 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-04dc22bb-7b52-452d-bc3d-2be25f7084a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:24.172212 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-04dc22bb-7b52-452d-bc3d-2be25f7084a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:24.172641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-04dc22bb-7b52-452d-bc3d-2be25f7084a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:24.173321 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-04dc22bb-7b52-452d-bc3d-2be25f7084a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:24.173767 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-04dc22bb-7b52-452d-bc3d-2be25f7084a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:24.174182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-04dc22bb-7b52-452d-bc3d-2be25f7084a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:24.317316 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-04dc22bb-7b52-452d-bc3d-2be25f7084a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:24.325955 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-04dc22bb-7b52-452d-bc3d-2be25f7084a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1516 microversion: 2.1 time: 0.166046 Aug 24 17:50:24.326896 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 160/308] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:24 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:24.673603 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d74283c4-805b-4e01-b576-e888eaac13fe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:24.674889 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d74283c4-805b-4e01-b576-e888eaac13fe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:24.688498 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d74283c4-805b-4e01-b576-e888eaac13fe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:24.689114 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d74283c4-805b-4e01-b576-e888eaac13fe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:24.689725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d74283c4-805b-4e01-b576-e888eaac13fe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:24.690453 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d74283c4-805b-4e01-b576-e888eaac13fe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:24.690998 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d74283c4-805b-4e01-b576-e888eaac13fe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:24.691438 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d74283c4-805b-4e01-b576-e888eaac13fe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:24.913606 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d74283c4-805b-4e01-b576-e888eaac13fe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:24.936364 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d74283c4-805b-4e01-b576-e888eaac13fe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:24.938636 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d74283c4-805b-4e01-b576-e888eaac13fe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:24.940307 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d74283c4-805b-4e01-b576-e888eaac13fe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.272114 Aug 24 17:50:24.957551 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 149/309] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:24 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:25.760238 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6082c091-8b71-4bf1-a793-ad02f7ee1a33 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Action: 'create', calling method: .version_select at 0x7f4b29aa48b0>, body: {"keypair": {"name": "tempest-keypair-529029050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSAdCMltueM4JrisgFXFuu2jeFgkgmji1IscrFK/MSKHGRuPDxAyr6LttlxFjt30/N20TtBbaZRpu8Eethnc4sciayq0D8BsTntKiNqJf0YIA/MJslQsZBdSb0/QMoEdQ=="}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:25.777215 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-6082c091-8b71-4bf1-a793-ad02f7ee1a33 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Getting quotas for project 0fb78a439e20439f8d93a4f7df3f28f8. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:50:25.781348 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-6082c091-8b71-4bf1-a793-ad02f7ee1a33 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Getting quotas for user 7d3139d9e58f4b56a370661e2a5d4e5e and project 0fb78a439e20439f8d93a4f7df3f28f8. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:50:25.807131 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6082c091-8b71-4bf1-a793-ad02f7ee1a33 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051265 Aug 24 17:50:25.808281 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 161/310] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 17:50:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:50:25.968724 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a18ae671-907f-4133-9f4a-7a50ab5cdec7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:25.969879 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a18ae671-907f-4133-9f4a-7a50ab5cdec7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:25.983560 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a18ae671-907f-4133-9f4a-7a50ab5cdec7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:25.984051 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a18ae671-907f-4133-9f4a-7a50ab5cdec7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:25.985163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a18ae671-907f-4133-9f4a-7a50ab5cdec7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:25.986589 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a18ae671-907f-4133-9f4a-7a50ab5cdec7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:25.987208 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a18ae671-907f-4133-9f4a-7a50ab5cdec7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:25.987896 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a18ae671-907f-4133-9f4a-7a50ab5cdec7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:26.249639 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a18ae671-907f-4133-9f4a-7a50ab5cdec7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:26.258826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a18ae671-907f-4133-9f4a-7a50ab5cdec7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:26.267903 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a18ae671-907f-4133-9f4a-7a50ab5cdec7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:26.269131 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a18ae671-907f-4133-9f4a-7a50ab5cdec7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.306365 Aug 24 17:50:26.269695 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 150/311] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:25 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:27.296767 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-2f04daf7-5ec0-4654-b261-7c5048a9c95e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:27.297383 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-2f04daf7-5ec0-4654-b261-7c5048a9c95e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:27.305539 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2f04daf7-5ec0-4654-b261-7c5048a9c95e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:27.306279 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2f04daf7-5ec0-4654-b261-7c5048a9c95e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:27.306873 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2f04daf7-5ec0-4654-b261-7c5048a9c95e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:27.307788 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2f04daf7-5ec0-4654-b261-7c5048a9c95e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:27.308902 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2f04daf7-5ec0-4654-b261-7c5048a9c95e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:27.309603 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2f04daf7-5ec0-4654-b261-7c5048a9c95e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:27.652304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-2f04daf7-5ec0-4654-b261-7c5048a9c95e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:27.677909 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-2f04daf7-5ec0-4654-b261-7c5048a9c95e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:27.679430 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-2f04daf7-5ec0-4654-b261-7c5048a9c95e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:27.680670 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-2f04daf7-5ec0-4654-b261-7c5048a9c95e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.387876 Aug 24 17:50:27.681560 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 162/312] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:27 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:28.003807 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-972150606", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42250e67-e026-4ee8-a8ab-86c733e9a211"}], "security_groups": [{"name": "tempest-securitygroup--1001523146"}], "key_name": "tempest-keypair-529029050", "user_data": "}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:28.704590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4d975147-4179-4fee-b677-55cf560dd978 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:28.705276 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4d975147-4179-4fee-b677-55cf560dd978 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:28.714951 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d975147-4179-4fee-b677-55cf560dd978 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:28.716172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d975147-4179-4fee-b677-55cf560dd978 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:28.717272 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d975147-4179-4fee-b677-55cf560dd978 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:28.718367 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d975147-4179-4fee-b677-55cf560dd978 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:28.719048 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d975147-4179-4fee-b677-55cf560dd978 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:28.720135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d975147-4179-4fee-b677-55cf560dd978 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:28.878038 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4d975147-4179-4fee-b677-55cf560dd978 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:28.889135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4d975147-4179-4fee-b677-55cf560dd978 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:28.890838 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4d975147-4179-4fee-b677-55cf560dd978 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:28.892206 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4d975147-4179-4fee-b677-55cf560dd978 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.191953 Aug 24 17:50:28.892991 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 163/313] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:28 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:29.919509 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-cb063c56-5e01-4d6d-a98a-00d67a7f4013 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:29.920550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-cb063c56-5e01-4d6d-a98a-00d67a7f4013 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:29.927279 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cb063c56-5e01-4d6d-a98a-00d67a7f4013 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:29.928358 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cb063c56-5e01-4d6d-a98a-00d67a7f4013 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:29.929020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cb063c56-5e01-4d6d-a98a-00d67a7f4013 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:29.929848 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cb063c56-5e01-4d6d-a98a-00d67a7f4013 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:29.930460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cb063c56-5e01-4d6d-a98a-00d67a7f4013 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:29.931066 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cb063c56-5e01-4d6d-a98a-00d67a7f4013 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:30.151329 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-cb063c56-5e01-4d6d-a98a-00d67a7f4013 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:30.165224 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-cb063c56-5e01-4d6d-a98a-00d67a7f4013 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:30.169778 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-cb063c56-5e01-4d6d-a98a-00d67a7f4013 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:30.172698 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-cb063c56-5e01-4d6d-a98a-00d67a7f4013 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.257400 Aug 24 17:50:30.174272 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 164/314] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:29 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:31.202387 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5547a3df-c724-4809-bd86-d1c9dcd738ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:31.203379 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5547a3df-c724-4809-bd86-d1c9dcd738ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:31.217223 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5547a3df-c724-4809-bd86-d1c9dcd738ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:31.218064 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5547a3df-c724-4809-bd86-d1c9dcd738ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:31.218730 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5547a3df-c724-4809-bd86-d1c9dcd738ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:31.219722 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5547a3df-c724-4809-bd86-d1c9dcd738ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:31.230056 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5547a3df-c724-4809-bd86-d1c9dcd738ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:31.230560 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5547a3df-c724-4809-bd86-d1c9dcd738ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:31.570163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5547a3df-c724-4809-bd86-d1c9dcd738ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:31.586081 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5547a3df-c724-4809-bd86-d1c9dcd738ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:31.588502 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5547a3df-c724-4809-bd86-d1c9dcd738ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:31.591697 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5547a3df-c724-4809-bd86-d1c9dcd738ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.398468 Aug 24 17:50:31.594459 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 165/315] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:31 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:32.616950 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8ea3bf4e-5931-4cdf-b0ec-cc4f4b2fc269 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:32.617803 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8ea3bf4e-5931-4cdf-b0ec-cc4f4b2fc269 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:32.629058 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8ea3bf4e-5931-4cdf-b0ec-cc4f4b2fc269 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:32.629305 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8ea3bf4e-5931-4cdf-b0ec-cc4f4b2fc269 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:32.629757 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8ea3bf4e-5931-4cdf-b0ec-cc4f4b2fc269 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:32.631015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8ea3bf4e-5931-4cdf-b0ec-cc4f4b2fc269 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:32.637791 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8ea3bf4e-5931-4cdf-b0ec-cc4f4b2fc269 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:32.638485 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8ea3bf4e-5931-4cdf-b0ec-cc4f4b2fc269 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:33.003801 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8ea3bf4e-5931-4cdf-b0ec-cc4f4b2fc269 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:33.023422 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8ea3bf4e-5931-4cdf-b0ec-cc4f4b2fc269 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:33.026711 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8ea3bf4e-5931-4cdf-b0ec-cc4f4b2fc269 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:33.030199 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8ea3bf4e-5931-4cdf-b0ec-cc4f4b2fc269 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.416795 Aug 24 17:50:33.032184 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 166/316] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:32 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:34.058490 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a3e0303c-34ed-4a59-b024-b5e4bdcd8539 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:34.060139 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a3e0303c-34ed-4a59-b024-b5e4bdcd8539 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:34.077184 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a3e0303c-34ed-4a59-b024-b5e4bdcd8539 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:34.077963 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a3e0303c-34ed-4a59-b024-b5e4bdcd8539 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:34.078748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a3e0303c-34ed-4a59-b024-b5e4bdcd8539 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:34.082333 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a3e0303c-34ed-4a59-b024-b5e4bdcd8539 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:34.085504 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a3e0303c-34ed-4a59-b024-b5e4bdcd8539 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:34.088100 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a3e0303c-34ed-4a59-b024-b5e4bdcd8539 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:34.388481 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a3e0303c-34ed-4a59-b024-b5e4bdcd8539 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:34.407809 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a3e0303c-34ed-4a59-b024-b5e4bdcd8539 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:34.409410 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a3e0303c-34ed-4a59-b024-b5e4bdcd8539 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:34.415079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a3e0303c-34ed-4a59-b024-b5e4bdcd8539 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1743 microversion: 2.20 time: 0.361303 Aug 24 17:50:34.433631 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 167/317] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:34 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1743 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:35.444736 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d94823eb-dd05-4f33-b04a-2ab5d165a8a8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:35.449709 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d94823eb-dd05-4f33-b04a-2ab5d165a8a8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:35.457270 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d94823eb-dd05-4f33-b04a-2ab5d165a8a8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:35.459915 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d94823eb-dd05-4f33-b04a-2ab5d165a8a8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:35.460594 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d94823eb-dd05-4f33-b04a-2ab5d165a8a8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:35.461540 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d94823eb-dd05-4f33-b04a-2ab5d165a8a8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:35.462197 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d94823eb-dd05-4f33-b04a-2ab5d165a8a8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:35.462915 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d94823eb-dd05-4f33-b04a-2ab5d165a8a8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:35.786692 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d94823eb-dd05-4f33-b04a-2ab5d165a8a8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:35.789403 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=4 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:35.798395 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d94823eb-dd05-4f33-b04a-2ab5d165a8a8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:35.800848 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d94823eb-dd05-4f33-b04a-2ab5d165a8a8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:35.803919 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d94823eb-dd05-4f33-b04a-2ab5d165a8a8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1743 microversion: 2.20 time: 0.363999 Aug 24 17:50:35.812247 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 168/318] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:35 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1743 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:36.257982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:36.834484 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-113f314c-4ed6-4b2e-be92-e0669aa04918 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:36.836152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-113f314c-4ed6-4b2e-be92-e0669aa04918 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:36.844527 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-113f314c-4ed6-4b2e-be92-e0669aa04918 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:36.845381 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-113f314c-4ed6-4b2e-be92-e0669aa04918 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:36.846125 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-113f314c-4ed6-4b2e-be92-e0669aa04918 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:36.847157 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-113f314c-4ed6-4b2e-be92-e0669aa04918 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:36.847829 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-113f314c-4ed6-4b2e-be92-e0669aa04918 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:36.848442 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-113f314c-4ed6-4b2e-be92-e0669aa04918 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:37.097750 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-113f314c-4ed6-4b2e-be92-e0669aa04918 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:37.112296 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-113f314c-4ed6-4b2e-be92-e0669aa04918 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:37.114147 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-113f314c-4ed6-4b2e-be92-e0669aa04918 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:37.117871 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-113f314c-4ed6-4b2e-be92-e0669aa04918 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.290146 Aug 24 17:50:37.119783 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 169/319] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:36 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:50:38.018736 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=39 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:38.151358 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-17b480bb-3eb2-46db-99a7-bb0bee5431c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:38.152699 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-17b480bb-3eb2-46db-99a7-bb0bee5431c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:38.154663 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:38.174595 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17b480bb-3eb2-46db-99a7-bb0bee5431c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:38.175535 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17b480bb-3eb2-46db-99a7-bb0bee5431c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:38.176199 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17b480bb-3eb2-46db-99a7-bb0bee5431c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:38.177200 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17b480bb-3eb2-46db-99a7-bb0bee5431c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:38.177965 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17b480bb-3eb2-46db-99a7-bb0bee5431c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:38.178569 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17b480bb-3eb2-46db-99a7-bb0bee5431c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:38.814429 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-17b480bb-3eb2-46db-99a7-bb0bee5431c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:38.827698 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-17b480bb-3eb2-46db-99a7-bb0bee5431c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:38.841286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-17b480bb-3eb2-46db-99a7-bb0bee5431c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:38.843353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-17b480bb-3eb2-46db-99a7-bb0bee5431c5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.696161 Aug 24 17:50:38.882628 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 170/320] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:38 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:38.894047 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-cf19d54a-8a7c-4132-834b-6e2d8bd87d01 req-4c7a339e-56b3-4b32-9103-be669583c5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11705238-e9d4-4c1e-ab49-d5a27eb4df4c", "name": "network-vif-plugged", "status": "completed", "tag": "41c4ee25-50fb-45d7-9866-1d83514f02d5"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:38.916679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-cf19d54a-8a7c-4132-834b-6e2d8bd87d01 req-4c7a339e-56b3-4b32-9103-be669583c5b0 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:38.917162 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-cf19d54a-8a7c-4132-834b-6e2d8bd87d01 req-4c7a339e-56b3-4b32-9103-be669583c5b0 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:38.917738 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-cf19d54a-8a7c-4132-834b-6e2d8bd87d01 req-4c7a339e-56b3-4b32-9103-be669583c5b0 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:39.188463 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-cf19d54a-8a7c-4132-834b-6e2d8bd87d01 req-4c7a339e-56b3-4b32-9103-be669583c5b0 service nova] Creating event network-vif-plugged:41c4ee25-50fb-45d7-9866-1d83514f02d5 for instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c on hv-cinder-84052 Aug 24 17:50:39.199086 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-cf19d54a-8a7c-4132-834b-6e2d8bd87d01 req-4c7a339e-56b3-4b32-9103-be669583c5b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.313348 Aug 24 17:50:39.204548 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 171/321] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:39.872817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f88c46a4-5f17-438d-b03e-cd26ccbb363f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:39.873528 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f88c46a4-5f17-438d-b03e-cd26ccbb363f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:39.884069 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f88c46a4-5f17-438d-b03e-cd26ccbb363f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:39.884604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f88c46a4-5f17-438d-b03e-cd26ccbb363f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:39.885063 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f88c46a4-5f17-438d-b03e-cd26ccbb363f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:39.885730 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f88c46a4-5f17-438d-b03e-cd26ccbb363f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:39.886190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f88c46a4-5f17-438d-b03e-cd26ccbb363f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:39.886618 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f88c46a4-5f17-438d-b03e-cd26ccbb363f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:40.366290 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f88c46a4-5f17-438d-b03e-cd26ccbb363f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:40.382198 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f88c46a4-5f17-438d-b03e-cd26ccbb363f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:40.387808 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f88c46a4-5f17-438d-b03e-cd26ccbb363f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:40.389390 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f88c46a4-5f17-438d-b03e-cd26ccbb363f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.522739 Aug 24 17:50:40.400486 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 172/322] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:39 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:50:40.674876 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] validate_networks() for [('42250e67-e026-4ee8-a8ab-86c733e9a211', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:50:41.417041 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-adb76115-5c62-41ad-bdb1-7f823691925c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:41.419711 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-adb76115-5c62-41ad-bdb1-7f823691925c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:41.435184 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-adb76115-5c62-41ad-bdb1-7f823691925c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:41.435716 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-adb76115-5c62-41ad-bdb1-7f823691925c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:41.436161 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-adb76115-5c62-41ad-bdb1-7f823691925c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:41.436931 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-adb76115-5c62-41ad-bdb1-7f823691925c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:41.437386 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-adb76115-5c62-41ad-bdb1-7f823691925c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:41.437816 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-adb76115-5c62-41ad-bdb1-7f823691925c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:41.786429 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-adb76115-5c62-41ad-bdb1-7f823691925c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:41.795163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-adb76115-5c62-41ad-bdb1-7f823691925c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:41.821141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-adb76115-5c62-41ad-bdb1-7f823691925c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:41.822540 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-adb76115-5c62-41ad-bdb1-7f823691925c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.409425 Aug 24 17:50:41.847563 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 173/323] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:41 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:50:41.971169 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:50:41.971707 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:50:41.972084 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:50:41.972625 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:50:41.973056 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:50:42.003022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:42.007830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:42.008357 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:42.009562 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:42.010040 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:42.011994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:42.088182 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Getting quotas for project 0fb78a439e20439f8d93a4f7df3f28f8. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:50:42.099948 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Getting quotas for user 7d3139d9e58f4b56a370661e2a5d4e5e and project 0fb78a439e20439f8d93a4f7df3f28f8. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:50:42.132865 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:50:42.135658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:50:42.271378 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1ab06df0-e3fd-43c8-8557-18ed2f59206b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 14.276084 Aug 24 17:50:42.285386 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5909a43d-8806-4e14-92fb-c260a007a705 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:42.286276 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5909a43d-8806-4e14-92fb-c260a007a705 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:42.296156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 151/324] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:50:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 14301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:50:42.381127 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5909a43d-8806-4e14-92fb-c260a007a705 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:42.395393 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5909a43d-8806-4e14-92fb-c260a007a705 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1244 microversion: 2.1 time: 0.113737 Aug 24 17:50:42.410063 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 174/325] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:42 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1244 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:42.850721 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-86a7001e-428e-4ffa-b64c-7f089be1686a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:42.851643 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-86a7001e-428e-4ffa-b64c-7f089be1686a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:42.890511 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86a7001e-428e-4ffa-b64c-7f089be1686a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:42.904846 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86a7001e-428e-4ffa-b64c-7f089be1686a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:42.905401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86a7001e-428e-4ffa-b64c-7f089be1686a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:42.906130 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86a7001e-428e-4ffa-b64c-7f089be1686a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:42.912391 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86a7001e-428e-4ffa-b64c-7f089be1686a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:42.912907 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86a7001e-428e-4ffa-b64c-7f089be1686a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:43.418443 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f869c016-1ce3-46f5-8e8e-3288a85783aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:43.419762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f869c016-1ce3-46f5-8e8e-3288a85783aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:43.436847 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f869c016-1ce3-46f5-8e8e-3288a85783aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:43.440601 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f869c016-1ce3-46f5-8e8e-3288a85783aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:43.441071 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f869c016-1ce3-46f5-8e8e-3288a85783aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:43.441824 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f869c016-1ce3-46f5-8e8e-3288a85783aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:43.442857 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f869c016-1ce3-46f5-8e8e-3288a85783aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:43.443299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f869c016-1ce3-46f5-8e8e-3288a85783aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:43.592565 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f869c016-1ce3-46f5-8e8e-3288a85783aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:43.601683 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f869c016-1ce3-46f5-8e8e-3288a85783aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1240 microversion: 2.1 time: 0.187793 Aug 24 17:50:43.602984 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 175/326] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:43 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1240 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:43.734367 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-86a7001e-428e-4ffa-b64c-7f089be1686a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:43.746393 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-86a7001e-428e-4ffa-b64c-7f089be1686a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:43.756776 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-86a7001e-428e-4ffa-b64c-7f089be1686a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:43.758421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-86a7001e-428e-4ffa-b64c-7f089be1686a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.915086 Aug 24 17:50:43.759000 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 152/327] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:42 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:44.628344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7a49bcc8-14d4-4fda-8cf7-7024458b34d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:44.628972 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7a49bcc8-14d4-4fda-8cf7-7024458b34d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:44.645333 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7a49bcc8-14d4-4fda-8cf7-7024458b34d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:44.648082 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7a49bcc8-14d4-4fda-8cf7-7024458b34d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:44.651160 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7a49bcc8-14d4-4fda-8cf7-7024458b34d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:44.652346 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7a49bcc8-14d4-4fda-8cf7-7024458b34d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:44.653345 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7a49bcc8-14d4-4fda-8cf7-7024458b34d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:44.654984 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7a49bcc8-14d4-4fda-8cf7-7024458b34d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:44.703794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=100 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:44.784857 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e8807a2a-b6ec-423f-aaad-1b4b77d85011 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:44.786788 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e8807a2a-b6ec-423f-aaad-1b4b77d85011 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:44.799079 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e8807a2a-b6ec-423f-aaad-1b4b77d85011 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:44.803815 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e8807a2a-b6ec-423f-aaad-1b4b77d85011 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:44.805608 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e8807a2a-b6ec-423f-aaad-1b4b77d85011 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:44.806762 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e8807a2a-b6ec-423f-aaad-1b4b77d85011 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:44.807388 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e8807a2a-b6ec-423f-aaad-1b4b77d85011 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:44.808070 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e8807a2a-b6ec-423f-aaad-1b4b77d85011 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:44.808871 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7a49bcc8-14d4-4fda-8cf7-7024458b34d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:44.819365 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7a49bcc8-14d4-4fda-8cf7-7024458b34d8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1302 microversion: 2.1 time: 0.195749 Aug 24 17:50:44.820630 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 176/328] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:44 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1302 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:45.219300 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e8807a2a-b6ec-423f-aaad-1b4b77d85011 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:45.242021 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e8807a2a-b6ec-423f-aaad-1b4b77d85011 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:45.244126 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e8807a2a-b6ec-423f-aaad-1b4b77d85011 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:45.248606 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e8807a2a-b6ec-423f-aaad-1b4b77d85011 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.465178 Aug 24 17:50:45.249906 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 153/329] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:44 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:50:45.850554 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-2a6b627c-4661-45a3-93f9-1cefd8c5847a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:45.851375 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-2a6b627c-4661-45a3-93f9-1cefd8c5847a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:45.866324 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2a6b627c-4661-45a3-93f9-1cefd8c5847a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:45.866839 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2a6b627c-4661-45a3-93f9-1cefd8c5847a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:45.868710 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2a6b627c-4661-45a3-93f9-1cefd8c5847a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:45.869826 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2a6b627c-4661-45a3-93f9-1cefd8c5847a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:45.870975 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2a6b627c-4661-45a3-93f9-1cefd8c5847a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:45.871665 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2a6b627c-4661-45a3-93f9-1cefd8c5847a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:46.017518 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-2a6b627c-4661-45a3-93f9-1cefd8c5847a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:46.040937 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-2a6b627c-4661-45a3-93f9-1cefd8c5847a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1302 microversion: 2.1 time: 0.202276 Aug 24 17:50:46.045400 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 177/330] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:45 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1302 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:46.273016 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6f01dfff-7564-45ff-8c12-87bfcf1e1856 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:46.275405 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6f01dfff-7564-45ff-8c12-87bfcf1e1856 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:46.293583 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6f01dfff-7564-45ff-8c12-87bfcf1e1856 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:46.297685 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6f01dfff-7564-45ff-8c12-87bfcf1e1856 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:46.298384 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6f01dfff-7564-45ff-8c12-87bfcf1e1856 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:46.299671 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6f01dfff-7564-45ff-8c12-87bfcf1e1856 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:46.301916 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6f01dfff-7564-45ff-8c12-87bfcf1e1856 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:46.303845 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6f01dfff-7564-45ff-8c12-87bfcf1e1856 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:46.742916 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6f01dfff-7564-45ff-8c12-87bfcf1e1856 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:46.754383 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6f01dfff-7564-45ff-8c12-87bfcf1e1856 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:46.756418 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6f01dfff-7564-45ff-8c12-87bfcf1e1856 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:46.758019 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6f01dfff-7564-45ff-8c12-87bfcf1e1856 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.489714 Aug 24 17:50:46.759133 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 154/331] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:46 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:46.994584 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-56febb2e-47f5-401b-94b0-9a1bfe0e6888 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Action: 'create', calling method: .version_select at 0x7f4b29bcef70>, body: {"keypair": {"name": "tempest-TestShelveInstance-768140014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETOs0iyX0bCmDlQvS6oAepn1kVfAUAnaLmeTQSljHpCIwagLU7lT+HX5Lh2QIeSAKcaxChm81nkMF0/FxdF7ZV6cciauvNLiuskLqdQOHVP33jknr4ZCR76DOOdezOcyg=="}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:47.021289 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-56febb2e-47f5-401b-94b0-9a1bfe0e6888 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Getting quotas for project 79ef0ce1ee884e9d80d4200d40b7b6c2. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:50:47.026016 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-56febb2e-47f5-401b-94b0-9a1bfe0e6888 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Getting quotas for user c75bb50ad7704e66983959d338b48e27 and project 79ef0ce1ee884e9d80d4200d40b7b6c2. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:50:47.055864 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-56febb2e-47f5-401b-94b0-9a1bfe0e6888 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.338509 Aug 24 17:50:47.057132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 178/332] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 17:50:46 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:47.069052 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7ebd4e40-9372-4ab1-8e3d-b203e4d8af06 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:47.069698 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7ebd4e40-9372-4ab1-8e3d-b203e4d8af06 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:47.080195 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ebd4e40-9372-4ab1-8e3d-b203e4d8af06 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:47.080712 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ebd4e40-9372-4ab1-8e3d-b203e4d8af06 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:47.081151 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ebd4e40-9372-4ab1-8e3d-b203e4d8af06 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:47.081859 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ebd4e40-9372-4ab1-8e3d-b203e4d8af06 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:47.082373 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ebd4e40-9372-4ab1-8e3d-b203e4d8af06 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:47.083299 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ebd4e40-9372-4ab1-8e3d-b203e4d8af06 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:47.405274 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7ebd4e40-9372-4ab1-8e3d-b203e4d8af06 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:47.414860 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7ebd4e40-9372-4ab1-8e3d-b203e4d8af06 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1370 microversion: 2.1 time: 0.352662 Aug 24 17:50:47.429601 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 155/333] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:47 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1370 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:47.696774 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-5e6cc997-a9cb-4f9e-a64d-694d3d52b7bf req-7ca860d2-6b21-42b7-8695-599c5915fa6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef24bd4c-630a-428f-9eb7-50c5009e9fe1", "tag": "22d0b6c6-ad45-4659-a4f0-1d8f89c1671d"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:47.724395 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-5e6cc997-a9cb-4f9e-a64d-694d3d52b7bf req-7ca860d2-6b21-42b7-8695-599c5915fa6b service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:47.724395 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-5e6cc997-a9cb-4f9e-a64d-694d3d52b7bf req-7ca860d2-6b21-42b7-8695-599c5915fa6b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:47.724395 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-5e6cc997-a9cb-4f9e-a64d-694d3d52b7bf req-7ca860d2-6b21-42b7-8695-599c5915fa6b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:47.758971 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-5e6cc997-a9cb-4f9e-a64d-694d3d52b7bf req-7ca860d2-6b21-42b7-8695-599c5915fa6b service nova] Creating event network-changed:22d0b6c6-ad45-4659-a4f0-1d8f89c1671d for instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 on hv-cinder-84052 Aug 24 17:50:47.772098 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-5e6cc997-a9cb-4f9e-a64d-694d3d52b7bf req-7ca860d2-6b21-42b7-8695-599c5915fa6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079995 Aug 24 17:50:47.773307 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 179/334] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:47.789272 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7d44bd3c-505e-43f6-a2f4-70b818894797 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:47.793998 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7d44bd3c-505e-43f6-a2f4-70b818894797 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:47.807918 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7d44bd3c-505e-43f6-a2f4-70b818894797 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:47.810459 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7d44bd3c-505e-43f6-a2f4-70b818894797 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:47.813095 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7d44bd3c-505e-43f6-a2f4-70b818894797 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:47.822139 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7d44bd3c-505e-43f6-a2f4-70b818894797 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:47.822923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7d44bd3c-505e-43f6-a2f4-70b818894797 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:47.825283 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7d44bd3c-505e-43f6-a2f4-70b818894797 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:48.251236 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-53931651-e1db-4b19-91bf-734c9ce0ea0d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d4aa00b-3fd9-457b-8eaf-22664e7648c3", "device": "/dev/sdb"}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:48.256454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-53931651-e1db-4b19-91bf-734c9ce0ea0d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:48.264751 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-53931651-e1db-4b19-91bf-734c9ce0ea0d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:48.266152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-53931651-e1db-4b19-91bf-734c9ce0ea0d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:48.266828 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-53931651-e1db-4b19-91bf-734c9ce0ea0d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:48.268414 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-53931651-e1db-4b19-91bf-734c9ce0ea0d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:48.269098 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-53931651-e1db-4b19-91bf-734c9ce0ea0d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:48.269738 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-53931651-e1db-4b19-91bf-734c9ce0ea0d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:48.366870 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7d44bd3c-505e-43f6-a2f4-70b818894797 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:48.380462 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7d44bd3c-505e-43f6-a2f4-70b818894797 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:48.385491 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7d44bd3c-505e-43f6-a2f4-70b818894797 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:48.387254 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7d44bd3c-505e-43f6-a2f4-70b818894797 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.607398 Aug 24 17:50:48.388374 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 156/335] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:47 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:48.437491 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-73653326-e161-4794-b863-e0d4b930f1e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:48.439280 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-73653326-e161-4794-b863-e0d4b930f1e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:48.445989 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-73653326-e161-4794-b863-e0d4b930f1e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:48.446834 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-73653326-e161-4794-b863-e0d4b930f1e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:48.447502 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-73653326-e161-4794-b863-e0d4b930f1e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:48.448965 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-73653326-e161-4794-b863-e0d4b930f1e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:48.449626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-73653326-e161-4794-b863-e0d4b930f1e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:48.450255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-73653326-e161-4794-b863-e0d4b930f1e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:48.919644 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-53931651-e1db-4b19-91bf-734c9ce0ea0d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "POST /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674093 Aug 24 17:50:48.920470 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 180/336] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:50:48 2022] POST /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e/os-volume_attachments => generated 194 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:50:49.249776 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-73653326-e161-4794-b863-e0d4b930f1e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:49.270084 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-73653326-e161-4794-b863-e0d4b930f1e0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1370 microversion: 2.1 time: 0.836746 Aug 24 17:50:49.274036 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 157/337] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:48 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1370 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:50:49.416283 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0aa59261-5838-4a3d-943f-3bd576772ed0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:49.417570 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0aa59261-5838-4a3d-943f-3bd576772ed0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:49.429179 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0aa59261-5838-4a3d-943f-3bd576772ed0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:49.431724 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0aa59261-5838-4a3d-943f-3bd576772ed0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:49.441180 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0aa59261-5838-4a3d-943f-3bd576772ed0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:49.443840 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0aa59261-5838-4a3d-943f-3bd576772ed0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:49.445805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0aa59261-5838-4a3d-943f-3bd576772ed0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:49.457158 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0aa59261-5838-4a3d-943f-3bd576772ed0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:49.698499 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0aa59261-5838-4a3d-943f-3bd576772ed0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:49.709627 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0aa59261-5838-4a3d-943f-3bd576772ed0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:49.715802 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0aa59261-5838-4a3d-943f-3bd576772ed0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:49.717321 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0aa59261-5838-4a3d-943f-3bd576772ed0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.306676 Aug 24 17:50:49.732235 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 181/338] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:49 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:50.294012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b8340877-64e1-451c-aff1-766f1bb0dbf4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:50.294797 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b8340877-64e1-451c-aff1-766f1bb0dbf4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:50.302931 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8340877-64e1-451c-aff1-766f1bb0dbf4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:50.303423 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8340877-64e1-451c-aff1-766f1bb0dbf4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:50.303901 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8340877-64e1-451c-aff1-766f1bb0dbf4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:50.304757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8340877-64e1-451c-aff1-766f1bb0dbf4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:50.305041 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8340877-64e1-451c-aff1-766f1bb0dbf4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:50.305463 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8340877-64e1-451c-aff1-766f1bb0dbf4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:50.741732 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7b0d4057-f760-4799-b3d6-2eb3e12af352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:50.742967 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7b0d4057-f760-4799-b3d6-2eb3e12af352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:50.759902 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b0d4057-f760-4799-b3d6-2eb3e12af352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:50.760579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b0d4057-f760-4799-b3d6-2eb3e12af352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:50.761133 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b0d4057-f760-4799-b3d6-2eb3e12af352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:50.772128 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b0d4057-f760-4799-b3d6-2eb3e12af352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:50.773001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b0d4057-f760-4799-b3d6-2eb3e12af352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:50.774176 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b0d4057-f760-4799-b3d6-2eb3e12af352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:51.056095 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7b0d4057-f760-4799-b3d6-2eb3e12af352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:51.069773 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7b0d4057-f760-4799-b3d6-2eb3e12af352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:51.071511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7b0d4057-f760-4799-b3d6-2eb3e12af352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:51.081190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7b0d4057-f760-4799-b3d6-2eb3e12af352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.343402 Aug 24 17:50:51.085980 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 182/339] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:50 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:50:51.101826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b8340877-64e1-451c-aff1-766f1bb0dbf4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:51.111776 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b8340877-64e1-451c-aff1-766f1bb0dbf4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1370 microversion: 2.1 time: 0.821426 Aug 24 17:50:51.112355 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 158/340] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:50 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1370 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:52.109093 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8e18a19b-6650-40c2-8185-89ed62aa2d54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:52.109705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8e18a19b-6650-40c2-8185-89ed62aa2d54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:52.128450 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8e18a19b-6650-40c2-8185-89ed62aa2d54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:52.128450 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8e18a19b-6650-40c2-8185-89ed62aa2d54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:52.128450 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8e18a19b-6650-40c2-8185-89ed62aa2d54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:52.128450 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8e18a19b-6650-40c2-8185-89ed62aa2d54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:52.128819 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8e18a19b-6650-40c2-8185-89ed62aa2d54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:52.128819 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8e18a19b-6650-40c2-8185-89ed62aa2d54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:52.136697 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c1c418cb-db26-4573-97da-4d60b46364f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:52.137317 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c1c418cb-db26-4573-97da-4d60b46364f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:52.140063 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:52.140741 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=6 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:52.154110 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c1c418cb-db26-4573-97da-4d60b46364f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:52.154642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c1c418cb-db26-4573-97da-4d60b46364f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:52.155081 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c1c418cb-db26-4573-97da-4d60b46364f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:52.157366 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c1c418cb-db26-4573-97da-4d60b46364f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:52.157894 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c1c418cb-db26-4573-97da-4d60b46364f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:52.159229 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c1c418cb-db26-4573-97da-4d60b46364f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:52.389897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c1c418cb-db26-4573-97da-4d60b46364f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:52.401794 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c1c418cb-db26-4573-97da-4d60b46364f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1370 microversion: 2.1 time: 0.268816 Aug 24 17:50:52.403877 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 159/341] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:52 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:52.557969 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8e18a19b-6650-40c2-8185-89ed62aa2d54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:52.575442 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8e18a19b-6650-40c2-8185-89ed62aa2d54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:52.580261 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8e18a19b-6650-40c2-8185-89ed62aa2d54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:52.581546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8e18a19b-6650-40c2-8185-89ed62aa2d54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.476754 Aug 24 17:50:52.600241 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 183/342] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:52 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:53.424433 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-de52b9f7-f8f5-4f6c-9325-276b457d92f2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:53.425134 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-de52b9f7-f8f5-4f6c-9325-276b457d92f2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:53.438787 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de52b9f7-f8f5-4f6c-9325-276b457d92f2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:53.445129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de52b9f7-f8f5-4f6c-9325-276b457d92f2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:53.445696 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de52b9f7-f8f5-4f6c-9325-276b457d92f2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:53.446702 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de52b9f7-f8f5-4f6c-9325-276b457d92f2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:53.447276 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de52b9f7-f8f5-4f6c-9325-276b457d92f2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:53.449298 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de52b9f7-f8f5-4f6c-9325-276b457d92f2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:53.609665 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-804ec92d-70f1-49b5-b833-f67144e3319c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:53.610248 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-804ec92d-70f1-49b5-b833-f67144e3319c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:53.628362 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-804ec92d-70f1-49b5-b833-f67144e3319c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:53.630006 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-804ec92d-70f1-49b5-b833-f67144e3319c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:53.630662 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-804ec92d-70f1-49b5-b833-f67144e3319c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:53.634246 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-804ec92d-70f1-49b5-b833-f67144e3319c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:53.636447 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-804ec92d-70f1-49b5-b833-f67144e3319c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:53.637071 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-804ec92d-70f1-49b5-b833-f67144e3319c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:53.676374 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-de52b9f7-f8f5-4f6c-9325-276b457d92f2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:53.685650 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-de52b9f7-f8f5-4f6c-9325-276b457d92f2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1370 microversion: 2.1 time: 0.266412 Aug 24 17:50:53.688006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 160/343] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:53 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:53.889692 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-804ec92d-70f1-49b5-b833-f67144e3319c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:53.909328 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-804ec92d-70f1-49b5-b833-f67144e3319c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:53.911214 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-804ec92d-70f1-49b5-b833-f67144e3319c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:53.912843 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-804ec92d-70f1-49b5-b833-f67144e3319c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.307891 Aug 24 17:50:53.915375 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 184/344] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:53 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:54.707784 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-725e4b91-37f0-42cd-a325-30501ba5b6b3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:54.708353 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-725e4b91-37f0-42cd-a325-30501ba5b6b3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:54.726370 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-725e4b91-37f0-42cd-a325-30501ba5b6b3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:54.727156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-725e4b91-37f0-42cd-a325-30501ba5b6b3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:54.727813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-725e4b91-37f0-42cd-a325-30501ba5b6b3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:54.728803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-725e4b91-37f0-42cd-a325-30501ba5b6b3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:54.729418 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-725e4b91-37f0-42cd-a325-30501ba5b6b3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:54.730013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-725e4b91-37f0-42cd-a325-30501ba5b6b3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:54.938434 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6b433a1f-e882-4438-937e-22946aa2913c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:54.939059 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-6b433a1f-e882-4438-937e-22946aa2913c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:54.947744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b433a1f-e882-4438-937e-22946aa2913c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:54.948242 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b433a1f-e882-4438-937e-22946aa2913c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:54.948680 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b433a1f-e882-4438-937e-22946aa2913c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:54.949396 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b433a1f-e882-4438-937e-22946aa2913c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:54.953675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b433a1f-e882-4438-937e-22946aa2913c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:54.954400 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6b433a1f-e882-4438-937e-22946aa2913c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:55.035709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-725e4b91-37f0-42cd-a325-30501ba5b6b3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:55.047575 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-725e4b91-37f0-42cd-a325-30501ba5b6b3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1370 microversion: 2.1 time: 0.344131 Aug 24 17:50:55.061402 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 161/345] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:54 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1370 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:55.261494 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6b433a1f-e882-4438-937e-22946aa2913c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:55.275789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6b433a1f-e882-4438-937e-22946aa2913c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:55.278243 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6b433a1f-e882-4438-937e-22946aa2913c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:55.279910 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6b433a1f-e882-4438-937e-22946aa2913c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.345620 Aug 24 17:50:55.286143 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 185/346] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:54 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:55.419407 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-60f88aa7-7933-4dcd-b520-abce297fa431 req-41f0679a-a458-45cf-9d6c-bbde5a49eb81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef24bd4c-630a-428f-9eb7-50c5009e9fe1", "name": "network-vif-plugged", "status": "completed", "tag": "22d0b6c6-ad45-4659-a4f0-1d8f89c1671d"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:50:55.433751 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-60f88aa7-7933-4dcd-b520-abce297fa431 req-41f0679a-a458-45cf-9d6c-bbde5a49eb81 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:55.434957 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-60f88aa7-7933-4dcd-b520-abce297fa431 req-41f0679a-a458-45cf-9d6c-bbde5a49eb81 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:55.435693 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-60f88aa7-7933-4dcd-b520-abce297fa431 req-41f0679a-a458-45cf-9d6c-bbde5a49eb81 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:55.457700 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-60f88aa7-7933-4dcd-b520-abce297fa431 req-41f0679a-a458-45cf-9d6c-bbde5a49eb81 service nova] Creating event network-vif-plugged:22d0b6c6-ad45-4659-a4f0-1d8f89c1671d for instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 on hv-cinder-84052 Aug 24 17:50:55.467979 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-60f88aa7-7933-4dcd-b520-abce297fa431 req-41f0679a-a458-45cf-9d6c-bbde5a49eb81 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051721 Aug 24 17:50:55.470863 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 162/347] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:50:56.069440 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ca5f147f-8679-4f60-ad96-6b9a887e96d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:56.071335 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ca5f147f-8679-4f60-ad96-6b9a887e96d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:56.079070 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca5f147f-8679-4f60-ad96-6b9a887e96d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:56.080419 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca5f147f-8679-4f60-ad96-6b9a887e96d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:56.081165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca5f147f-8679-4f60-ad96-6b9a887e96d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:56.082768 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca5f147f-8679-4f60-ad96-6b9a887e96d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:56.083616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca5f147f-8679-4f60-ad96-6b9a887e96d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:56.084202 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca5f147f-8679-4f60-ad96-6b9a887e96d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:56.311980 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2b41a6f0-f311-412d-8470-60a275a26ebf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:56.313338 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2b41a6f0-f311-412d-8470-60a275a26ebf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:56.325460 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2b41a6f0-f311-412d-8470-60a275a26ebf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:56.328070 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2b41a6f0-f311-412d-8470-60a275a26ebf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:56.332793 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2b41a6f0-f311-412d-8470-60a275a26ebf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:56.333781 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2b41a6f0-f311-412d-8470-60a275a26ebf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:56.334403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2b41a6f0-f311-412d-8470-60a275a26ebf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:56.335001 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2b41a6f0-f311-412d-8470-60a275a26ebf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:56.630338 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ca5f147f-8679-4f60-ad96-6b9a887e96d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:56.640214 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ca5f147f-8679-4f60-ad96-6b9a887e96d0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1370 microversion: 2.1 time: 0.575008 Aug 24 17:50:56.652648 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 186/348] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:56 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1370 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:56.978511 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2b41a6f0-f311-412d-8470-60a275a26ebf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:56.989794 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2b41a6f0-f311-412d-8470-60a275a26ebf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:56.991394 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2b41a6f0-f311-412d-8470-60a275a26ebf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:56.992798 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2b41a6f0-f311-412d-8470-60a275a26ebf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.685260 Aug 24 17:50:56.993521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 163/349] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:56 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:50:57.674017 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e2f8736a-a8c1-4877-bb33-51dafc38b7cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:57.680344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e2f8736a-a8c1-4877-bb33-51dafc38b7cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:57.683729 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=6 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:50:57.688688 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2f8736a-a8c1-4877-bb33-51dafc38b7cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:57.689468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2f8736a-a8c1-4877-bb33-51dafc38b7cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:57.689967 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2f8736a-a8c1-4877-bb33-51dafc38b7cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:57.690872 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2f8736a-a8c1-4877-bb33-51dafc38b7cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:57.692038 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2f8736a-a8c1-4877-bb33-51dafc38b7cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:57.692551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2f8736a-a8c1-4877-bb33-51dafc38b7cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:57.921867 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e2f8736a-a8c1-4877-bb33-51dafc38b7cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:57.944011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e2f8736a-a8c1-4877-bb33-51dafc38b7cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1370 microversion: 2.1 time: 0.272537 Aug 24 17:50:57.945197 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 187/350] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:57 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:58.018534 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1a3ada09-7d28-4f5b-a6a7-5684643bc947 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:58.019821 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1a3ada09-7d28-4f5b-a6a7-5684643bc947 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:58.039560 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1a3ada09-7d28-4f5b-a6a7-5684643bc947 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:58.043080 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1a3ada09-7d28-4f5b-a6a7-5684643bc947 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:58.043789 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1a3ada09-7d28-4f5b-a6a7-5684643bc947 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:58.049561 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1a3ada09-7d28-4f5b-a6a7-5684643bc947 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:58.050324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1a3ada09-7d28-4f5b-a6a7-5684643bc947 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:58.051523 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1a3ada09-7d28-4f5b-a6a7-5684643bc947 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:58.403322 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1a3ada09-7d28-4f5b-a6a7-5684643bc947 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:58.417668 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1a3ada09-7d28-4f5b-a6a7-5684643bc947 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:58.419180 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1a3ada09-7d28-4f5b-a6a7-5684643bc947 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:58.420405 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1a3ada09-7d28-4f5b-a6a7-5684643bc947 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.407376 Aug 24 17:50:58.420951 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 164/351] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:58 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:50:58.965765 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5441caeb-b5a6-46b6-a5e9-c9dc97d9e67d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:58.966383 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5441caeb-b5a6-46b6-a5e9-c9dc97d9e67d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:58.975581 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5441caeb-b5a6-46b6-a5e9-c9dc97d9e67d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:58.976395 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5441caeb-b5a6-46b6-a5e9-c9dc97d9e67d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:58.977061 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5441caeb-b5a6-46b6-a5e9-c9dc97d9e67d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:58.977998 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5441caeb-b5a6-46b6-a5e9-c9dc97d9e67d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:58.978867 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5441caeb-b5a6-46b6-a5e9-c9dc97d9e67d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:58.979825 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5441caeb-b5a6-46b6-a5e9-c9dc97d9e67d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:59.211626 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5441caeb-b5a6-46b6-a5e9-c9dc97d9e67d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:59.225020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5441caeb-b5a6-46b6-a5e9-c9dc97d9e67d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1370 microversion: 2.1 time: 0.261209 Aug 24 17:50:59.225995 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 188/352] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:50:58 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:50:59.449768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-83e3e1ef-d9ba-4744-a363-4d2241a6ca02 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:50:59.450585 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-83e3e1ef-d9ba-4744-a363-4d2241a6ca02 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:50:59.458159 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-83e3e1ef-d9ba-4744-a363-4d2241a6ca02 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:59.458732 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-83e3e1ef-d9ba-4744-a363-4d2241a6ca02 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:59.459187 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-83e3e1ef-d9ba-4744-a363-4d2241a6ca02 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:59.459841 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-83e3e1ef-d9ba-4744-a363-4d2241a6ca02 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:50:59.460236 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-83e3e1ef-d9ba-4744-a363-4d2241a6ca02 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:50:59.460738 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-83e3e1ef-d9ba-4744-a363-4d2241a6ca02 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:50:59.700783 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-83e3e1ef-d9ba-4744-a363-4d2241a6ca02 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:59.711580 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-83e3e1ef-d9ba-4744-a363-4d2241a6ca02 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:59.713141 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-83e3e1ef-d9ba-4744-a363-4d2241a6ca02 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:50:59.714814 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-83e3e1ef-d9ba-4744-a363-4d2241a6ca02 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.269328 Aug 24 17:50:59.733585 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 165/353] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:50:59 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:00.250311 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d01fd9bf-0035-4d05-b6d6-7de191a2b0b7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:00.250923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d01fd9bf-0035-4d05-b6d6-7de191a2b0b7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:00.262188 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d01fd9bf-0035-4d05-b6d6-7de191a2b0b7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:00.263007 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d01fd9bf-0035-4d05-b6d6-7de191a2b0b7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:00.263941 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d01fd9bf-0035-4d05-b6d6-7de191a2b0b7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:00.264749 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d01fd9bf-0035-4d05-b6d6-7de191a2b0b7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:00.265295 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d01fd9bf-0035-4d05-b6d6-7de191a2b0b7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:00.269879 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d01fd9bf-0035-4d05-b6d6-7de191a2b0b7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:00.475930 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d01fd9bf-0035-4d05-b6d6-7de191a2b0b7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:00.483898 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d01fd9bf-0035-4d05-b6d6-7de191a2b0b7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1370 microversion: 2.1 time: 0.237903 Aug 24 17:51:00.497865 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 189/354] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:00 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:00.742441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ea7870d2-af10-4f37-8723-894db1d4de92 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:00.745094 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ea7870d2-af10-4f37-8723-894db1d4de92 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:00.754602 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ea7870d2-af10-4f37-8723-894db1d4de92 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:00.755510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ea7870d2-af10-4f37-8723-894db1d4de92 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:00.756189 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ea7870d2-af10-4f37-8723-894db1d4de92 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:00.757119 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ea7870d2-af10-4f37-8723-894db1d4de92 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:00.758739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ea7870d2-af10-4f37-8723-894db1d4de92 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:00.759397 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ea7870d2-af10-4f37-8723-894db1d4de92 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:01.164663 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ea7870d2-af10-4f37-8723-894db1d4de92 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:01.174621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ea7870d2-af10-4f37-8723-894db1d4de92 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:01.177546 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ea7870d2-af10-4f37-8723-894db1d4de92 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:01.178915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ea7870d2-af10-4f37-8723-894db1d4de92 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1738 microversion: 2.20 time: 0.444763 Aug 24 17:51:01.180128 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 166/355] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:00 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1738 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:01.506534 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-16401064-eceb-491e-9ab7-f679237daab7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:01.507311 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-16401064-eceb-491e-9ab7-f679237daab7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:01.520679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16401064-eceb-491e-9ab7-f679237daab7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:01.521172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16401064-eceb-491e-9ab7-f679237daab7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:01.525967 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16401064-eceb-491e-9ab7-f679237daab7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:01.526299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16401064-eceb-491e-9ab7-f679237daab7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:01.526785 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16401064-eceb-491e-9ab7-f679237daab7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:01.527220 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16401064-eceb-491e-9ab7-f679237daab7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:01.789499 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-16401064-eceb-491e-9ab7-f679237daab7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:01.807617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-16401064-eceb-491e-9ab7-f679237daab7 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1564 microversion: 2.1 time: 0.305372 Aug 24 17:51:01.832935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 190/356] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:01 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1564 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:01.856625 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-59180d7f-97c9-4d73-a818-bd8853c31c9c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:01.857238 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-59180d7f-97c9-4d73-a818-bd8853c31c9c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:01.868078 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-59180d7f-97c9-4d73-a818-bd8853c31c9c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:01.868570 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-59180d7f-97c9-4d73-a818-bd8853c31c9c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:01.868982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-59180d7f-97c9-4d73-a818-bd8853c31c9c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:01.869696 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-59180d7f-97c9-4d73-a818-bd8853c31c9c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:01.870185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-59180d7f-97c9-4d73-a818-bd8853c31c9c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:01.870604 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-59180d7f-97c9-4d73-a818-bd8853c31c9c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:02.206511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b28ad67b-7f1f-424a-8bce-cb7e99cdaf15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:02.207640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b28ad67b-7f1f-424a-8bce-cb7e99cdaf15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:02.216682 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b28ad67b-7f1f-424a-8bce-cb7e99cdaf15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:02.219255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b28ad67b-7f1f-424a-8bce-cb7e99cdaf15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:02.219255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b28ad67b-7f1f-424a-8bce-cb7e99cdaf15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:02.219255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b28ad67b-7f1f-424a-8bce-cb7e99cdaf15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:02.223743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-59180d7f-97c9-4d73-a818-bd8853c31c9c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.371474 Aug 24 17:51:02.224935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 167/357] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 17:51:01 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-interface => generated 285 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:02.225303 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b28ad67b-7f1f-424a-8bce-cb7e99cdaf15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:02.226068 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b28ad67b-7f1f-424a-8bce-cb7e99cdaf15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:02.747151 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b28ad67b-7f1f-424a-8bce-cb7e99cdaf15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:02.765632 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b28ad67b-7f1f-424a-8bce-cb7e99cdaf15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:02.768766 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b28ad67b-7f1f-424a-8bce-cb7e99cdaf15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:02.771036 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b28ad67b-7f1f-424a-8bce-cb7e99cdaf15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1720 microversion: 2.20 time: 0.571782 Aug 24 17:51:02.771966 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 191/358] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:02 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1720 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:03.798732 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d0f1d32e-ce5f-415e-af80-21595394bc0c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:03.799518 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d0f1d32e-ce5f-415e-af80-21595394bc0c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:03.808987 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d0f1d32e-ce5f-415e-af80-21595394bc0c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:03.809587 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d0f1d32e-ce5f-415e-af80-21595394bc0c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:03.810125 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d0f1d32e-ce5f-415e-af80-21595394bc0c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:03.810939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d0f1d32e-ce5f-415e-af80-21595394bc0c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:03.811511 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d0f1d32e-ce5f-415e-af80-21595394bc0c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:03.812225 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d0f1d32e-ce5f-415e-af80-21595394bc0c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:04.000968 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d0f1d32e-ce5f-415e-af80-21595394bc0c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:04.018563 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d0f1d32e-ce5f-415e-af80-21595394bc0c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:04.022620 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d0f1d32e-ce5f-415e-af80-21595394bc0c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:04.025060 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d0f1d32e-ce5f-415e-af80-21595394bc0c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1720 microversion: 2.20 time: 0.234356 Aug 24 17:51:04.027891 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 168/359] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:03 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1720 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:04.495138 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-1bf3530f-55db-4099-b88a-4a809c97b6be req-ab5c0d06-6447-4d5d-9d9f-a1ab46cd943c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef24bd4c-630a-428f-9eb7-50c5009e9fe1", "tag": "22d0b6c6-ad45-4659-a4f0-1d8f89c1671d"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:04.505732 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-1bf3530f-55db-4099-b88a-4a809c97b6be req-ab5c0d06-6447-4d5d-9d9f-a1ab46cd943c service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:04.506503 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-1bf3530f-55db-4099-b88a-4a809c97b6be req-ab5c0d06-6447-4d5d-9d9f-a1ab46cd943c service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:04.507103 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-1bf3530f-55db-4099-b88a-4a809c97b6be req-ab5c0d06-6447-4d5d-9d9f-a1ab46cd943c service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:04.525158 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-1bf3530f-55db-4099-b88a-4a809c97b6be req-ab5c0d06-6447-4d5d-9d9f-a1ab46cd943c service nova] Creating event network-changed:22d0b6c6-ad45-4659-a4f0-1d8f89c1671d for instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 on hv-cinder-84052 Aug 24 17:51:04.531354 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-1bf3530f-55db-4099-b88a-4a809c97b6be req-ab5c0d06-6447-4d5d-9d9f-a1ab46cd943c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043800 Aug 24 17:51:04.535655 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 192/360] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:05.048457 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-49a44ad3-3a93-4e1d-94dd-e201025287a7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:05.050075 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-49a44ad3-3a93-4e1d-94dd-e201025287a7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:05.068142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-49a44ad3-3a93-4e1d-94dd-e201025287a7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.068758 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-49a44ad3-3a93-4e1d-94dd-e201025287a7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.069218 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-49a44ad3-3a93-4e1d-94dd-e201025287a7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.070211 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-49a44ad3-3a93-4e1d-94dd-e201025287a7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.070676 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-49a44ad3-3a93-4e1d-94dd-e201025287a7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.071106 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-49a44ad3-3a93-4e1d-94dd-e201025287a7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.085535 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=100 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:05.341662 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-7225b978-c047-4b29-8a11-3087eedc922b req-8a15f373-b72a-44fa-a5e2-1dc817acd62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11705238-e9d4-4c1e-ab49-d5a27eb4df4c", "name": "network-vif-unplugged", "status": "completed", "tag": "41c4ee25-50fb-45d7-9866-1d83514f02d5"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:05.368890 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7225b978-c047-4b29-8a11-3087eedc922b req-8a15f373-b72a-44fa-a5e2-1dc817acd62a service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:05.371387 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7225b978-c047-4b29-8a11-3087eedc922b req-8a15f373-b72a-44fa-a5e2-1dc817acd62a service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:05.373094 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7225b978-c047-4b29-8a11-3087eedc922b req-8a15f373-b72a-44fa-a5e2-1dc817acd62a service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:05.426450 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-7225b978-c047-4b29-8a11-3087eedc922b req-8a15f373-b72a-44fa-a5e2-1dc817acd62a service nova] Creating event network-vif-unplugged:41c4ee25-50fb-45d7-9866-1d83514f02d5 for instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c on hv-cinder-84052 Aug 24 17:51:05.445369 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-7225b978-c047-4b29-8a11-3087eedc922b req-8a15f373-b72a-44fa-a5e2-1dc817acd62a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111361 Aug 24 17:51:05.447460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 193/361] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:05.580794 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-49a44ad3-3a93-4e1d-94dd-e201025287a7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:05.590166 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-49a44ad3-3a93-4e1d-94dd-e201025287a7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:05.596233 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-49a44ad3-3a93-4e1d-94dd-e201025287a7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:05.599169 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-49a44ad3-3a93-4e1d-94dd-e201025287a7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1720 microversion: 2.20 time: 0.554657 Aug 24 17:51:05.601843 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 169/362] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:05 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1720 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:05.749793 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-df377046-383a-4ee9-a174-efb81cf3a663 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Action: 'create', calling method: .version_select at 0x7f4b29c968b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1899728589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3HIG0HVB3F4jH6YBo07t6+b1VAvXckFXkiBHw1Sr6t9OnhgGHUWVa7Kc2EwZ1uhJF7+XtmdaOO8EZWtbTqi5rVwnccVhNBbQIoUqsu4eLEFat2REzJ2xb7obkIzclnXA=="}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:05.769768 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-df377046-383a-4ee9-a174-efb81cf3a663 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Getting quotas for project b9cd3cd0a9434f5ab0e1e1c52145beb2. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:51:05.775326 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-df377046-383a-4ee9-a174-efb81cf3a663 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Getting quotas for user 4279761de1464be38860432a46a89074 and project b9cd3cd0a9434f5ab0e1e1c52145beb2. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:51:05.824063 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-df377046-383a-4ee9-a174-efb81cf3a663 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.306043 Aug 24 17:51:05.831702 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 194/363] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 17:51:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:06.622725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f2036d4b-911a-4275-8509-fd8b7b12a1e8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:06.624182 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f2036d4b-911a-4275-8509-fd8b7b12a1e8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:06.631168 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2036d4b-911a-4275-8509-fd8b7b12a1e8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:06.631695 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2036d4b-911a-4275-8509-fd8b7b12a1e8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:06.632131 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2036d4b-911a-4275-8509-fd8b7b12a1e8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:06.632832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2036d4b-911a-4275-8509-fd8b7b12a1e8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:06.633280 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2036d4b-911a-4275-8509-fd8b7b12a1e8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:06.633691 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2036d4b-911a-4275-8509-fd8b7b12a1e8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:06.780499 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f2036d4b-911a-4275-8509-fd8b7b12a1e8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:06.788970 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f2036d4b-911a-4275-8509-fd8b7b12a1e8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:06.790463 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f2036d4b-911a-4275-8509-fd8b7b12a1e8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:06.791681 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-f2036d4b-911a-4275-8509-fd8b7b12a1e8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1720 microversion: 2.20 time: 0.173079 Aug 24 17:51:06.796203 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 170/364] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:06 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:07.814246 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8b9c324b-1601-48ae-8e3f-523d5948594b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:07.814977 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8b9c324b-1601-48ae-8e3f-523d5948594b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:07.822738 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b9c324b-1601-48ae-8e3f-523d5948594b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:07.823232 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b9c324b-1601-48ae-8e3f-523d5948594b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:07.823708 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b9c324b-1601-48ae-8e3f-523d5948594b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:07.824408 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b9c324b-1601-48ae-8e3f-523d5948594b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:07.824892 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b9c324b-1601-48ae-8e3f-523d5948594b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:07.825343 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b9c324b-1601-48ae-8e3f-523d5948594b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:07.988409 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8b9c324b-1601-48ae-8e3f-523d5948594b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:07.998299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:08.016815 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8b9c324b-1601-48ae-8e3f-523d5948594b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:08.018856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8b9c324b-1601-48ae-8e3f-523d5948594b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:08.021095 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8b9c324b-1601-48ae-8e3f-523d5948594b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1720 microversion: 2.20 time: 0.209990 Aug 24 17:51:08.021674 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 195/365] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:07 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:09.046172 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-df5407e9-0728-4e8c-9f2e-4a797fd1532d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:09.046778 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-df5407e9-0728-4e8c-9f2e-4a797fd1532d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:09.049110 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:09.056162 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-df5407e9-0728-4e8c-9f2e-4a797fd1532d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:09.056644 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-df5407e9-0728-4e8c-9f2e-4a797fd1532d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:09.057077 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-df5407e9-0728-4e8c-9f2e-4a797fd1532d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:09.057761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-df5407e9-0728-4e8c-9f2e-4a797fd1532d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:09.058210 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-df5407e9-0728-4e8c-9f2e-4a797fd1532d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:09.058629 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-df5407e9-0728-4e8c-9f2e-4a797fd1532d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:09.191420 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-df5407e9-0728-4e8c-9f2e-4a797fd1532d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:09.199455 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-df5407e9-0728-4e8c-9f2e-4a797fd1532d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:09.200976 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-df5407e9-0728-4e8c-9f2e-4a797fd1532d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:09.202125 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-df5407e9-0728-4e8c-9f2e-4a797fd1532d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1720 microversion: 2.20 time: 0.159898 Aug 24 17:51:09.202673 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 171/366] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:09 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:10.225939 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-63019921-c121-4547-9ee3-095b39d39d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:10.226699 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-63019921-c121-4547-9ee3-095b39d39d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:10.229430 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:10.235924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-63019921-c121-4547-9ee3-095b39d39d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:10.236403 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-63019921-c121-4547-9ee3-095b39d39d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:10.236907 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-63019921-c121-4547-9ee3-095b39d39d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:10.238242 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-63019921-c121-4547-9ee3-095b39d39d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:10.238872 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-63019921-c121-4547-9ee3-095b39d39d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:10.239604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-63019921-c121-4547-9ee3-095b39d39d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:10.379810 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-63019921-c121-4547-9ee3-095b39d39d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:10.388636 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-63019921-c121-4547-9ee3-095b39d39d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:10.392961 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-63019921-c121-4547-9ee3-095b39d39d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:10.392961 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-63019921-c121-4547-9ee3-095b39d39d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1720 microversion: 2.20 time: 0.171862 Aug 24 17:51:10.406090 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 196/367] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:10 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:11.432189 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a477b534-ace1-47f0-9b8e-cb46f42a5bf6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:11.432710 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a477b534-ace1-47f0-9b8e-cb46f42a5bf6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:11.439012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a477b534-ace1-47f0-9b8e-cb46f42a5bf6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.439497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a477b534-ace1-47f0-9b8e-cb46f42a5bf6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.440162 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a477b534-ace1-47f0-9b8e-cb46f42a5bf6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.440929 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a477b534-ace1-47f0-9b8e-cb46f42a5bf6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.441383 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a477b534-ace1-47f0-9b8e-cb46f42a5bf6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.442008 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a477b534-ace1-47f0-9b8e-cb46f42a5bf6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.577713 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a477b534-ace1-47f0-9b8e-cb46f42a5bf6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:11.586188 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a477b534-ace1-47f0-9b8e-cb46f42a5bf6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:11.587867 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a477b534-ace1-47f0-9b8e-cb46f42a5bf6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:11.589325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a477b534-ace1-47f0-9b8e-cb46f42a5bf6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1663 microversion: 2.20 time: 0.161258 Aug 24 17:51:11.589879 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 172/368] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:11 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:11.614014 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e467e2a2-3ba3-48bc-b438-0ff47daa63ee tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51616b69-2660-4a49-91ed-0840d6d74f9a"}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:11.617214 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e467e2a2-3ba3-48bc-b438-0ff47daa63ee tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:11.625011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e467e2a2-3ba3-48bc-b438-0ff47daa63ee tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.625011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e467e2a2-3ba3-48bc-b438-0ff47daa63ee tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.625011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e467e2a2-3ba3-48bc-b438-0ff47daa63ee tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.625360 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e467e2a2-3ba3-48bc-b438-0ff47daa63ee tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:11.625745 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e467e2a2-3ba3-48bc-b438-0ff47daa63ee tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:11.626205 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e467e2a2-3ba3-48bc-b438-0ff47daa63ee tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:11.771326 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-228516207", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-768140014", "security_groups": [{"name": "tempest-secgroup-smoke-192845372"}], "networks": [{"uuid": "3e1e5e53-af70-4029-8cfd-e50d2d607333"}], "block_device_mapping_v2": [{"uuid": "1298308b-f527-4a56-86b4-ecbbdf029f08", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:11.912989 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] validate_networks() for [('3e1e5e53-af70-4029-8cfd-e50d2d607333', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:51:11.981826 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e467e2a2-3ba3-48bc-b438-0ff47daa63ee tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "POST /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.372787 Aug 24 17:51:11.982971 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 197/369] 10.222.0.27 () {62 vars in 1364 bytes} [Wed Aug 24 17:51:11 2022] POST /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/os-volume_attachments => generated 188 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:51:12.139244 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c326eab8-54c8-4129-8aa2-8b7005702509 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:12.140039 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c326eab8-54c8-4129-8aa2-8b7005702509 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:12.147327 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c326eab8-54c8-4129-8aa2-8b7005702509 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.147987 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c326eab8-54c8-4129-8aa2-8b7005702509 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.148524 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c326eab8-54c8-4129-8aa2-8b7005702509 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.149309 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c326eab8-54c8-4129-8aa2-8b7005702509 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.149862 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c326eab8-54c8-4129-8aa2-8b7005702509 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.150373 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c326eab8-54c8-4129-8aa2-8b7005702509 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.201167 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c326eab8-54c8-4129-8aa2-8b7005702509 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126994) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 17:51:12.285602 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c326eab8-54c8-4129-8aa2-8b7005702509 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "POST /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/action" status: 202 len: 0 microversion: 2.20 time: 0.150129 Aug 24 17:51:12.286216 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 198/370] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Aug 24 17:51:12 2022] POST /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:51:12.294359 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-380788b1-2575-43f2-93df-3fbe472ca52f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:12.295015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-380788b1-2575-43f2-93df-3fbe472ca52f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:12.302674 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-380788b1-2575-43f2-93df-3fbe472ca52f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.303388 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-380788b1-2575-43f2-93df-3fbe472ca52f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.303826 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-380788b1-2575-43f2-93df-3fbe472ca52f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.304424 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-380788b1-2575-43f2-93df-3fbe472ca52f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.304750 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-380788b1-2575-43f2-93df-3fbe472ca52f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.305158 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-380788b1-2575-43f2-93df-3fbe472ca52f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.465463 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-380788b1-2575-43f2-93df-3fbe472ca52f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:12.483932 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-380788b1-2575-43f2-93df-3fbe472ca52f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:12.485440 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-380788b1-2575-43f2-93df-3fbe472ca52f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:12.486629 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-380788b1-2575-43f2-93df-3fbe472ca52f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1749 microversion: 2.20 time: 0.196222 Aug 24 17:51:12.487177 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 199/371] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:12 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1749 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:12.578656 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:51:12.579214 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:51:12.579598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:51:12.580034 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:51:12.580429 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:51:12.589981 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.590460 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.590883 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.591637 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:12.592085 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:12.592500 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:12.612996 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Getting quotas for project 79ef0ce1ee884e9d80d4200d40b7b6c2. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:51:12.617814 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Getting quotas for user c75bb50ad7704e66983959d338b48e27 and project 79ef0ce1ee884e9d80d4200d40b7b6c2. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:51:12.682409 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:51:12.686188 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1298308b-f527-4a56-86b4-ecbbdf029f08',volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:51:12.859427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a2ba64de-7d4f-4cb1-a77a-e1e0fc6c4d80 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.092277 Aug 24 17:51:12.860116 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 173/372] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:51:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:51:12.872127 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ef17b794-9331-42bc-b528-6aecc65ae65b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:12.873406 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ef17b794-9331-42bc-b528-6aecc65ae65b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:12.944361 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ef17b794-9331-42bc-b528-6aecc65ae65b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:12.961626 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ef17b794-9331-42bc-b528-6aecc65ae65b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1087 microversion: 2.1 time: 0.094618 Aug 24 17:51:12.962301 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 200/373] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:12 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1087 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:13.511831 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e229f9a2-d37f-46c4-a531-d94d68135170 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:13.512859 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e229f9a2-d37f-46c4-a531-d94d68135170 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:13.520449 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e229f9a2-d37f-46c4-a531-d94d68135170 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.521061 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e229f9a2-d37f-46c4-a531-d94d68135170 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.521601 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e229f9a2-d37f-46c4-a531-d94d68135170 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.522546 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e229f9a2-d37f-46c4-a531-d94d68135170 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.523186 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e229f9a2-d37f-46c4-a531-d94d68135170 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.523923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e229f9a2-d37f-46c4-a531-d94d68135170 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.674033 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e229f9a2-d37f-46c4-a531-d94d68135170 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:13.683498 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e229f9a2-d37f-46c4-a531-d94d68135170 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:13.685045 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e229f9a2-d37f-46c4-a531-d94d68135170 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:13.686192 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e229f9a2-d37f-46c4-a531-d94d68135170 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1751 microversion: 2.20 time: 0.179581 Aug 24 17:51:13.686735 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 174/374] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:13 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:13.771411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9af110e0-b4f2-4b29-95fa-396a76401408 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:13.771952 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9af110e0-b4f2-4b29-95fa-396a76401408 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:13.778309 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9af110e0-b4f2-4b29-95fa-396a76401408 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.778805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9af110e0-b4f2-4b29-95fa-396a76401408 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.779283 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9af110e0-b4f2-4b29-95fa-396a76401408 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.779974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9af110e0-b4f2-4b29-95fa-396a76401408 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.780551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9af110e0-b4f2-4b29-95fa-396a76401408 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.780868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9af110e0-b4f2-4b29-95fa-396a76401408 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.925235 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.objects.instance [None req-9af110e0-b4f2-4b29-95fa-396a76401408 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lazy-loading 'services' on Instance uuid 08638681-706c-45de-8b52-d9fb2559b56e {{(pid=126994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:51:13.984605 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6f71856e-1da2-47c0-8336-54d9da8b021c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:13.986647 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6f71856e-1da2-47c0-8336-54d9da8b021c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:13.994297 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6f71856e-1da2-47c0-8336-54d9da8b021c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:13.995528 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6f71856e-1da2-47c0-8336-54d9da8b021c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:13.996755 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6f71856e-1da2-47c0-8336-54d9da8b021c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:13.998630 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6f71856e-1da2-47c0-8336-54d9da8b021c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.001795 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6f71856e-1da2-47c0-8336-54d9da8b021c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.002755 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6f71856e-1da2-47c0-8336-54d9da8b021c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.086275 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9af110e0-b4f2-4b29-95fa-396a76401408 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "DELETE /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e/os-volume_attachments/8d4aa00b-3fd9-457b-8eaf-22664e7648c3" status: 202 len: 0 microversion: 2.1 time: 0.318652 Aug 24 17:51:14.087109 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 201/375] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 17:51:13 2022] DELETE /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e/os-volume_attachments/8d4aa00b-3fd9-457b-8eaf-22664e7648c3 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:51:14.104195 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6f71856e-1da2-47c0-8336-54d9da8b021c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:14.118576 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6f71856e-1da2-47c0-8336-54d9da8b021c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1193 microversion: 2.1 time: 0.138812 Aug 24 17:51:14.119239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 175/376] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:13 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1193 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:14.710687 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-03db6e62-2f6b-4691-87ba-7dfc4903f191 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:14.711438 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-03db6e62-2f6b-4691-87ba-7dfc4903f191 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:14.717858 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-03db6e62-2f6b-4691-87ba-7dfc4903f191 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.718343 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-03db6e62-2f6b-4691-87ba-7dfc4903f191 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.718788 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-03db6e62-2f6b-4691-87ba-7dfc4903f191 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:14.719513 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-03db6e62-2f6b-4691-87ba-7dfc4903f191 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:14.719970 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-03db6e62-2f6b-4691-87ba-7dfc4903f191 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:14.720390 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-03db6e62-2f6b-4691-87ba-7dfc4903f191 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.141049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-bc10cbff-53f6-43d5-8381-e1c6570a2288 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:15.142397 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-bc10cbff-53f6-43d5-8381-e1c6570a2288 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:15.151718 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc10cbff-53f6-43d5-8381-e1c6570a2288 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.152547 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc10cbff-53f6-43d5-8381-e1c6570a2288 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.153840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc10cbff-53f6-43d5-8381-e1c6570a2288 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.155882 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc10cbff-53f6-43d5-8381-e1c6570a2288 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.156857 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc10cbff-53f6-43d5-8381-e1c6570a2288 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.158407 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc10cbff-53f6-43d5-8381-e1c6570a2288 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.225050 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-03db6e62-2f6b-4691-87ba-7dfc4903f191 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.247078 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-03db6e62-2f6b-4691-87ba-7dfc4903f191 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.249509 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-03db6e62-2f6b-4691-87ba-7dfc4903f191 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.258372 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-03db6e62-2f6b-4691-87ba-7dfc4903f191 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.552765 Aug 24 17:51:15.260545 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 202/377] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:14 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:15.397607 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-bc10cbff-53f6-43d5-8381-e1c6570a2288 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:15.405783 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-bc10cbff-53f6-43d5-8381-e1c6570a2288 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1270 microversion: 2.1 time: 0.268860 Aug 24 17:51:15.406356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 176/378] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:15 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1270 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:15.646773 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-7143a1b7-40d8-4471-acd6-afcd7efdd387 req-829cdcb1-19e5-4454-85b4-253d28ec87fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa859353-b309-4c9b-8f43-21b185b4f27d", "tag": "8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:15.663845 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7143a1b7-40d8-4471-acd6-afcd7efdd387 req-829cdcb1-19e5-4454-85b4-253d28ec87fe service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:15.664328 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7143a1b7-40d8-4471-acd6-afcd7efdd387 req-829cdcb1-19e5-4454-85b4-253d28ec87fe service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:15.665005 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-7143a1b7-40d8-4471-acd6-afcd7efdd387 req-829cdcb1-19e5-4454-85b4-253d28ec87fe service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:15.680464 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-7143a1b7-40d8-4471-acd6-afcd7efdd387 req-829cdcb1-19e5-4454-85b4-253d28ec87fe service nova] Creating event network-changed:8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba for instance aa859353-b309-4c9b-8f43-21b185b4f27d on hv-cinder-84052 Aug 24 17:51:15.685715 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-7143a1b7-40d8-4471-acd6-afcd7efdd387 req-829cdcb1-19e5-4454-85b4-253d28ec87fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043776 Aug 24 17:51:15.686401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 203/379] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:16.283103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8da1fd67-e7e5-4265-8a95-4726c659df46 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:16.283735 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8da1fd67-e7e5-4265-8a95-4726c659df46 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:16.290143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8da1fd67-e7e5-4265-8a95-4726c659df46 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.290626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8da1fd67-e7e5-4265-8a95-4726c659df46 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.291052 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8da1fd67-e7e5-4265-8a95-4726c659df46 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.291765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8da1fd67-e7e5-4265-8a95-4726c659df46 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.292214 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8da1fd67-e7e5-4265-8a95-4726c659df46 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.292629 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8da1fd67-e7e5-4265-8a95-4726c659df46 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.396678 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a06442fd-6cc2-4070-9101-a7edabd015a4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:16.397876 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a06442fd-6cc2-4070-9101-a7edabd015a4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:16.405780 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a06442fd-6cc2-4070-9101-a7edabd015a4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.406526 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a06442fd-6cc2-4070-9101-a7edabd015a4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.407123 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a06442fd-6cc2-4070-9101-a7edabd015a4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.408028 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a06442fd-6cc2-4070-9101-a7edabd015a4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.408973 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a06442fd-6cc2-4070-9101-a7edabd015a4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.409594 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a06442fd-6cc2-4070-9101-a7edabd015a4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.444305 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a06442fd-6cc2-4070-9101-a7edabd015a4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Going to try to terminate instance {{(pid=126994) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:51:16.521216 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8da1fd67-e7e5-4265-8a95-4726c659df46 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:16.538195 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8da1fd67-e7e5-4265-8a95-4726c659df46 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:16.540636 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8da1fd67-e7e5-4265-8a95-4726c659df46 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:16.542069 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8da1fd67-e7e5-4265-8a95-4726c659df46 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.262835 Aug 24 17:51:16.543247 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 177/380] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:16 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:16.548394 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-92a5073d-6d27-4d78-a5b2-0f11d3d2bf98 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:16.549415 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-92a5073d-6d27-4d78-a5b2-0f11d3d2bf98 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:16.562836 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-92a5073d-6d27-4d78-a5b2-0f11d3d2bf98 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.563460 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-92a5073d-6d27-4d78-a5b2-0f11d3d2bf98 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.563934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-92a5073d-6d27-4d78-a5b2-0f11d3d2bf98 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.564633 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-92a5073d-6d27-4d78-a5b2-0f11d3d2bf98 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.565092 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-92a5073d-6d27-4d78-a5b2-0f11d3d2bf98 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.566093 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-92a5073d-6d27-4d78-a5b2-0f11d3d2bf98 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.584138 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a06442fd-6cc2-4070-9101-a7edabd015a4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "DELETE /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 204 len: 0 microversion: 2.1 time: 0.191685 Aug 24 17:51:16.584924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 204/381] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:51:16 2022] DELETE /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:51:16.599012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a8fcfaf4-9c72-42b2-a317-e5a6bc5e48b6 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:16.600265 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a8fcfaf4-9c72-42b2-a317-e5a6bc5e48b6 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:16.607526 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8fcfaf4-9c72-42b2-a317-e5a6bc5e48b6 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.608558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8fcfaf4-9c72-42b2-a317-e5a6bc5e48b6 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.609216 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8fcfaf4-9c72-42b2-a317-e5a6bc5e48b6 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.610150 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8fcfaf4-9c72-42b2-a317-e5a6bc5e48b6 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:16.610864 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8fcfaf4-9c72-42b2-a317-e5a6bc5e48b6 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:16.611531 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8fcfaf4-9c72-42b2-a317-e5a6bc5e48b6 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:16.756803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-92a5073d-6d27-4d78-a5b2-0f11d3d2bf98 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:16.766311 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-92a5073d-6d27-4d78-a5b2-0f11d3d2bf98 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.221785 Aug 24 17:51:16.768775 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 178/382] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:16 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:16.810683 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a8fcfaf4-9c72-42b2-a317-e5a6bc5e48b6 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:16.819666 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a8fcfaf4-9c72-42b2-a317-e5a6bc5e48b6 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1513 microversion: 2.1 time: 0.227161 Aug 24 17:51:16.820519 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 205/383] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:16 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:17.568385 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a9187802-5e49-4719-bb1b-35f2b5519743 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:17.569126 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a9187802-5e49-4719-bb1b-35f2b5519743 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:17.575689 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a9187802-5e49-4719-bb1b-35f2b5519743 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.576250 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a9187802-5e49-4719-bb1b-35f2b5519743 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.576750 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a9187802-5e49-4719-bb1b-35f2b5519743 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.577454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a9187802-5e49-4719-bb1b-35f2b5519743 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.577957 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a9187802-5e49-4719-bb1b-35f2b5519743 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.578379 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a9187802-5e49-4719-bb1b-35f2b5519743 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.719884 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a9187802-5e49-4719-bb1b-35f2b5519743 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:17.729881 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a9187802-5e49-4719-bb1b-35f2b5519743 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:17.733275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a9187802-5e49-4719-bb1b-35f2b5519743 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:17.734794 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a9187802-5e49-4719-bb1b-35f2b5519743 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.171811 Aug 24 17:51:17.735382 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 179/384] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:17 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:17.796301 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-cce99af5-8119-4fdc-8728-1837b8b7b16e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:17.797116 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-cce99af5-8119-4fdc-8728-1837b8b7b16e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:17.806178 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cce99af5-8119-4fdc-8728-1837b8b7b16e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.807026 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cce99af5-8119-4fdc-8728-1837b8b7b16e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.807299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cce99af5-8119-4fdc-8728-1837b8b7b16e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.808159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cce99af5-8119-4fdc-8728-1837b8b7b16e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.808640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cce99af5-8119-4fdc-8728-1837b8b7b16e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.809347 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cce99af5-8119-4fdc-8728-1837b8b7b16e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.854525 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5bcc4fee-95d1-481e-ad99-2238dae7586f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:17.859830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5bcc4fee-95d1-481e-ad99-2238dae7586f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:17.879661 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5bcc4fee-95d1-481e-ad99-2238dae7586f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.880209 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5bcc4fee-95d1-481e-ad99-2238dae7586f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.880634 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5bcc4fee-95d1-481e-ad99-2238dae7586f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:17.881357 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5bcc4fee-95d1-481e-ad99-2238dae7586f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:17.881952 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5bcc4fee-95d1-481e-ad99-2238dae7586f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:17.882269 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5bcc4fee-95d1-481e-ad99-2238dae7586f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:18.025578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-cce99af5-8119-4fdc-8728-1837b8b7b16e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:18.042514 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-cce99af5-8119-4fdc-8728-1837b8b7b16e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.256094 Aug 24 17:51:18.043185 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 206/385] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:17 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:18.115624 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-5bcc4fee-95d1-481e-ad99-2238dae7586f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:18.123965 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5bcc4fee-95d1-481e-ad99-2238dae7586f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1513 microversion: 2.1 time: 0.283422 Aug 24 17:51:18.124728 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 180/386] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:17 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:18.758107 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-63de8d1d-06e1-464c-8c38-9c6164e01fe9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:18.759041 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-63de8d1d-06e1-464c-8c38-9c6164e01fe9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:18.765134 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-63de8d1d-06e1-464c-8c38-9c6164e01fe9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:18.765614 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-63de8d1d-06e1-464c-8c38-9c6164e01fe9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:18.766043 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-63de8d1d-06e1-464c-8c38-9c6164e01fe9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:18.766772 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-63de8d1d-06e1-464c-8c38-9c6164e01fe9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:18.767234 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-63de8d1d-06e1-464c-8c38-9c6164e01fe9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:18.767677 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-63de8d1d-06e1-464c-8c38-9c6164e01fe9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:18.924260 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-63de8d1d-06e1-464c-8c38-9c6164e01fe9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:18.934299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-63de8d1d-06e1-464c-8c38-9c6164e01fe9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:18.935803 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-63de8d1d-06e1-464c-8c38-9c6164e01fe9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:18.936960 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-63de8d1d-06e1-464c-8c38-9c6164e01fe9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.182922 Aug 24 17:51:18.937709 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 207/387] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:18 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:19.073033 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c5743978-9d53-4e6f-b333-8ddcf83929f8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:19.074982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c5743978-9d53-4e6f-b333-8ddcf83929f8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:19.082880 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c5743978-9d53-4e6f-b333-8ddcf83929f8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.083782 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c5743978-9d53-4e6f-b333-8ddcf83929f8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.084219 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c5743978-9d53-4e6f-b333-8ddcf83929f8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.085130 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c5743978-9d53-4e6f-b333-8ddcf83929f8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.085755 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c5743978-9d53-4e6f-b333-8ddcf83929f8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.086178 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c5743978-9d53-4e6f-b333-8ddcf83929f8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.152558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-2aa78c87-b9a3-43f3-8f10-660cd6c95b99 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:19.153845 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-2aa78c87-b9a3-43f3-8f10-660cd6c95b99 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:19.182392 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2aa78c87-b9a3-43f3-8f10-660cd6c95b99 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.183288 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2aa78c87-b9a3-43f3-8f10-660cd6c95b99 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.183997 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2aa78c87-b9a3-43f3-8f10-660cd6c95b99 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.185104 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2aa78c87-b9a3-43f3-8f10-660cd6c95b99 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.185723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2aa78c87-b9a3-43f3-8f10-660cd6c95b99 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.186373 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2aa78c87-b9a3-43f3-8f10-660cd6c95b99 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.192545 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:19.294413 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c5743978-9d53-4e6f-b333-8ddcf83929f8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:19.304875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c5743978-9d53-4e6f-b333-8ddcf83929f8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.242463 Aug 24 17:51:19.305861 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 181/388] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:19 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:19.350104 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-2aa78c87-b9a3-43f3-8f10-660cd6c95b99 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:19.358037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-2aa78c87-b9a3-43f3-8f10-660cd6c95b99 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1513 microversion: 2.1 time: 0.216005 Aug 24 17:51:19.358612 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 208/389] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:19 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:19.960636 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b371f320-e830-4946-97df-469ccae00bed tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:19.961274 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b371f320-e830-4946-97df-469ccae00bed tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:19.967536 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b371f320-e830-4946-97df-469ccae00bed tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.968024 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b371f320-e830-4946-97df-469ccae00bed tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.968453 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b371f320-e830-4946-97df-469ccae00bed tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:19.969146 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b371f320-e830-4946-97df-469ccae00bed tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:19.969598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b371f320-e830-4946-97df-469ccae00bed tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:19.970012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b371f320-e830-4946-97df-469ccae00bed tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:20.113274 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b371f320-e830-4946-97df-469ccae00bed tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:20.122612 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b371f320-e830-4946-97df-469ccae00bed tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:20.124168 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b371f320-e830-4946-97df-469ccae00bed tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:20.125345 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b371f320-e830-4946-97df-469ccae00bed tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.168668 Aug 24 17:51:20.125914 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 182/390] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:19 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:20.330273 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-49e2c373-76f9-42ba-b1da-32c7494103d5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:20.332563 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-49e2c373-76f9-42ba-b1da-32c7494103d5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:20.340363 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-49e2c373-76f9-42ba-b1da-32c7494103d5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:20.341088 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-49e2c373-76f9-42ba-b1da-32c7494103d5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:20.341814 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-49e2c373-76f9-42ba-b1da-32c7494103d5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:20.342796 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-49e2c373-76f9-42ba-b1da-32c7494103d5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:20.343436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-49e2c373-76f9-42ba-b1da-32c7494103d5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:20.344148 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-49e2c373-76f9-42ba-b1da-32c7494103d5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:20.380965 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-58cf9061-0450-4cbb-972f-1fb2e5aa5b10 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:20.383671 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-58cf9061-0450-4cbb-972f-1fb2e5aa5b10 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:20.390873 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58cf9061-0450-4cbb-972f-1fb2e5aa5b10 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:20.391736 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58cf9061-0450-4cbb-972f-1fb2e5aa5b10 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:20.392399 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58cf9061-0450-4cbb-972f-1fb2e5aa5b10 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:20.394018 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58cf9061-0450-4cbb-972f-1fb2e5aa5b10 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:20.394683 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58cf9061-0450-4cbb-972f-1fb2e5aa5b10 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:20.395390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58cf9061-0450-4cbb-972f-1fb2e5aa5b10 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:20.511417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-49e2c373-76f9-42ba-b1da-32c7494103d5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:20.526098 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-49e2c373-76f9-42ba-b1da-32c7494103d5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.201334 Aug 24 17:51:20.527286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 209/391] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:20 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:20.562890 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-58cf9061-0450-4cbb-972f-1fb2e5aa5b10 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:20.571512 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-58cf9061-0450-4cbb-972f-1fb2e5aa5b10 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1513 microversion: 2.1 time: 0.194201 Aug 24 17:51:20.572075 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 183/392] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:20 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:21.149199 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a2649b5e-0308-4f1f-895c-13066ad840d3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:21.149803 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a2649b5e-0308-4f1f-895c-13066ad840d3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:21.155883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2649b5e-0308-4f1f-895c-13066ad840d3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.156375 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2649b5e-0308-4f1f-895c-13066ad840d3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.156830 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2649b5e-0308-4f1f-895c-13066ad840d3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.157520 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2649b5e-0308-4f1f-895c-13066ad840d3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.157968 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2649b5e-0308-4f1f-895c-13066ad840d3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.158384 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2649b5e-0308-4f1f-895c-13066ad840d3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.302683 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a2649b5e-0308-4f1f-895c-13066ad840d3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:21.314052 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a2649b5e-0308-4f1f-895c-13066ad840d3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:21.316288 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a2649b5e-0308-4f1f-895c-13066ad840d3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:21.317559 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a2649b5e-0308-4f1f-895c-13066ad840d3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.172266 Aug 24 17:51:21.318428 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 210/393] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:21 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:21.548197 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-65531a03-80e8-4630-94bb-acf285c09d4a tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:21.548912 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-65531a03-80e8-4630-94bb-acf285c09d4a tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:21.556497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-65531a03-80e8-4630-94bb-acf285c09d4a tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.556994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-65531a03-80e8-4630-94bb-acf285c09d4a tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.557421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-65531a03-80e8-4630-94bb-acf285c09d4a tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.558378 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-65531a03-80e8-4630-94bb-acf285c09d4a tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.558831 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-65531a03-80e8-4630-94bb-acf285c09d4a tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.559245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-65531a03-80e8-4630-94bb-acf285c09d4a tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.597422 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ebe999ff-ecfe-432c-8ce4-a4e9457bc93b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:21.598073 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ebe999ff-ecfe-432c-8ce4-a4e9457bc93b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:21.607990 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ebe999ff-ecfe-432c-8ce4-a4e9457bc93b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.608473 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ebe999ff-ecfe-432c-8ce4-a4e9457bc93b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.608902 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ebe999ff-ecfe-432c-8ce4-a4e9457bc93b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.609596 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ebe999ff-ecfe-432c-8ce4-a4e9457bc93b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:21.610045 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ebe999ff-ecfe-432c-8ce4-a4e9457bc93b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:21.610463 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ebe999ff-ecfe-432c-8ce4-a4e9457bc93b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:21.730952 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-65531a03-80e8-4630-94bb-acf285c09d4a tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:21.739424 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-65531a03-80e8-4630-94bb-acf285c09d4a tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.195890 Aug 24 17:51:21.751318 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 184/394] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:21 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:21.755660 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ebe999ff-ecfe-432c-8ce4-a4e9457bc93b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:21.763444 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ebe999ff-ecfe-432c-8ce4-a4e9457bc93b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1513 microversion: 2.1 time: 0.170386 Aug 24 17:51:21.764041 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 211/395] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:21 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:22.341859 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-64381bd2-7581-45a5-ad1a-16f6949b1a84 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:22.342482 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-64381bd2-7581-45a5-ad1a-16f6949b1a84 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:22.348678 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-64381bd2-7581-45a5-ad1a-16f6949b1a84 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.349168 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-64381bd2-7581-45a5-ad1a-16f6949b1a84 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.349607 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-64381bd2-7581-45a5-ad1a-16f6949b1a84 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:22.350318 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-64381bd2-7581-45a5-ad1a-16f6949b1a84 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.350773 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-64381bd2-7581-45a5-ad1a-16f6949b1a84 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.351195 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-64381bd2-7581-45a5-ad1a-16f6949b1a84 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:22.501288 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-64381bd2-7581-45a5-ad1a-16f6949b1a84 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:22.511150 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-64381bd2-7581-45a5-ad1a-16f6949b1a84 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:22.512679 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-64381bd2-7581-45a5-ad1a-16f6949b1a84 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:22.513834 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-64381bd2-7581-45a5-ad1a-16f6949b1a84 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.176676 Aug 24 17:51:22.514388 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 185/396] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:22 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:22.760238 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0bde930c-8995-4721-bbf2-5d773d0988cd tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:22.760892 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0bde930c-8995-4721-bbf2-5d773d0988cd tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:22.768147 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0bde930c-8995-4721-bbf2-5d773d0988cd tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.768639 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0bde930c-8995-4721-bbf2-5d773d0988cd tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.769269 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0bde930c-8995-4721-bbf2-5d773d0988cd tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:22.769982 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0bde930c-8995-4721-bbf2-5d773d0988cd tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.770436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0bde930c-8995-4721-bbf2-5d773d0988cd tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.770858 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0bde930c-8995-4721-bbf2-5d773d0988cd tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:22.789725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ccd49866-13e5-4abb-a4d3-c975e8a9d91d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:22.791135 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ccd49866-13e5-4abb-a4d3-c975e8a9d91d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:22.795231 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:22.796012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=6 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:22.801095 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ccd49866-13e5-4abb-a4d3-c975e8a9d91d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.801588 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ccd49866-13e5-4abb-a4d3-c975e8a9d91d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.802024 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ccd49866-13e5-4abb-a4d3-c975e8a9d91d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:22.802731 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ccd49866-13e5-4abb-a4d3-c975e8a9d91d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:22.803186 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ccd49866-13e5-4abb-a4d3-c975e8a9d91d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:22.803639 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ccd49866-13e5-4abb-a4d3-c975e8a9d91d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:22.834559 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=100 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:22.939011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0bde930c-8995-4721-bbf2-5d773d0988cd tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:22.950550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0bde930c-8995-4721-bbf2-5d773d0988cd tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.194208 Aug 24 17:51:22.965578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 212/397] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:22 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:22.970723 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ccd49866-13e5-4abb-a4d3-c975e8a9d91d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:22.984221 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ccd49866-13e5-4abb-a4d3-c975e8a9d91d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1513 microversion: 2.1 time: 0.200834 Aug 24 17:51:22.985093 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 186/398] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:22 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:23.537492 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7b2651ba-00e8-4c23-bdcb-c4fff77cbadd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:23.538105 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7b2651ba-00e8-4c23-bdcb-c4fff77cbadd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:23.540066 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=6 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:23.545526 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b2651ba-00e8-4c23-bdcb-c4fff77cbadd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:23.546019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b2651ba-00e8-4c23-bdcb-c4fff77cbadd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:23.546455 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b2651ba-00e8-4c23-bdcb-c4fff77cbadd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:23.547161 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b2651ba-00e8-4c23-bdcb-c4fff77cbadd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:23.547647 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b2651ba-00e8-4c23-bdcb-c4fff77cbadd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:23.548074 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b2651ba-00e8-4c23-bdcb-c4fff77cbadd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:23.685827 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7b2651ba-00e8-4c23-bdcb-c4fff77cbadd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:23.694936 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7b2651ba-00e8-4c23-bdcb-c4fff77cbadd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:23.696483 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7b2651ba-00e8-4c23-bdcb-c4fff77cbadd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:23.697654 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7b2651ba-00e8-4c23-bdcb-c4fff77cbadd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.164835 Aug 24 17:51:23.698217 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 213/399] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:23 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:23.971856 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-38edea7e-44bb-4e1c-b75d-17e6db2a4059 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:23.972544 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-38edea7e-44bb-4e1c-b75d-17e6db2a4059 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:23.979356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-38edea7e-44bb-4e1c-b75d-17e6db2a4059 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:23.979930 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-38edea7e-44bb-4e1c-b75d-17e6db2a4059 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:23.980367 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-38edea7e-44bb-4e1c-b75d-17e6db2a4059 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:23.981417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-38edea7e-44bb-4e1c-b75d-17e6db2a4059 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:23.981853 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-38edea7e-44bb-4e1c-b75d-17e6db2a4059 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:23.982298 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-38edea7e-44bb-4e1c-b75d-17e6db2a4059 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.007858 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-df06320d-b598-4822-af59-75b1af33842b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:24.008478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-df06320d-b598-4822-af59-75b1af33842b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:24.015288 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-df06320d-b598-4822-af59-75b1af33842b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.015807 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-df06320d-b598-4822-af59-75b1af33842b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.016481 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-df06320d-b598-4822-af59-75b1af33842b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.017182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-df06320d-b598-4822-af59-75b1af33842b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.017830 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-df06320d-b598-4822-af59-75b1af33842b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.018473 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-df06320d-b598-4822-af59-75b1af33842b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.130570 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-38edea7e-44bb-4e1c-b75d-17e6db2a4059 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:24.138591 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-38edea7e-44bb-4e1c-b75d-17e6db2a4059 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.170938 Aug 24 17:51:24.139352 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 187/400] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:23 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:24.172236 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-df06320d-b598-4822-af59-75b1af33842b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:24.185256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-df06320d-b598-4822-af59-75b1af33842b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1513 microversion: 2.1 time: 0.182728 Aug 24 17:51:24.185835 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 214/401] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:24 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:24.720387 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4a029eb0-519e-4cfe-9760-a799b761f571 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:24.721132 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4a029eb0-519e-4cfe-9760-a799b761f571 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:24.727832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4a029eb0-519e-4cfe-9760-a799b761f571 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.728321 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4a029eb0-519e-4cfe-9760-a799b761f571 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.728757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4a029eb0-519e-4cfe-9760-a799b761f571 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.729451 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4a029eb0-519e-4cfe-9760-a799b761f571 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:24.729906 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4a029eb0-519e-4cfe-9760-a799b761f571 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:24.730331 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4a029eb0-519e-4cfe-9760-a799b761f571 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:24.874325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4a029eb0-519e-4cfe-9760-a799b761f571 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:24.884052 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4a029eb0-519e-4cfe-9760-a799b761f571 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:24.885611 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4a029eb0-519e-4cfe-9760-a799b761f571 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:24.886879 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4a029eb0-519e-4cfe-9760-a799b761f571 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.170375 Aug 24 17:51:24.887442 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 188/402] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:24 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:25.158813 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0ec20768-2bb2-44d7-84ca-4db0d54b16fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:25.159456 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0ec20768-2bb2-44d7-84ca-4db0d54b16fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:25.166006 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ec20768-2bb2-44d7-84ca-4db0d54b16fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.166498 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ec20768-2bb2-44d7-84ca-4db0d54b16fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.166938 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ec20768-2bb2-44d7-84ca-4db0d54b16fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.167878 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ec20768-2bb2-44d7-84ca-4db0d54b16fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.168350 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ec20768-2bb2-44d7-84ca-4db0d54b16fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.168813 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ec20768-2bb2-44d7-84ca-4db0d54b16fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.206663 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-423b07a4-25d5-4b58-b557-b479aaa3765e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:25.207265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-423b07a4-25d5-4b58-b557-b479aaa3765e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:25.214320 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-423b07a4-25d5-4b58-b557-b479aaa3765e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.214813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-423b07a4-25d5-4b58-b557-b479aaa3765e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.215247 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-423b07a4-25d5-4b58-b557-b479aaa3765e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.215982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-423b07a4-25d5-4b58-b557-b479aaa3765e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.216437 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-423b07a4-25d5-4b58-b557-b479aaa3765e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.216861 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-423b07a4-25d5-4b58-b557-b479aaa3765e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.316200 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0ec20768-2bb2-44d7-84ca-4db0d54b16fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:25.325351 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0ec20768-2bb2-44d7-84ca-4db0d54b16fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.170677 Aug 24 17:51:25.326180 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 215/403] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:25 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:25.362986 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-423b07a4-25d5-4b58-b557-b479aaa3765e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:25.370975 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-423b07a4-25d5-4b58-b557-b479aaa3765e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1513 microversion: 2.1 time: 0.168693 Aug 24 17:51:25.371555 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 189/404] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:25 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:25.634767 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-624744561", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1899728589", "security_groups": [{"name": "tempest-secgroup-smoke-1035260104"}], "block_device_mapping_v2": [{"uuid": "f98aa1e4-b578-4c01-af7a-83866f47c27c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "670b2ce6-025e-49c8-81a1-b5bd33c90dee"}]}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:25.763991 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.network.neutron [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] validate_networks() for [('670b2ce6-025e-49c8-81a1-b5bd33c90dee', None, None, None, None, None)] {{(pid=126994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:51:25.910497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-cbdf0513-19c9-46d3-a731-8cb3a3a3987d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:25.911145 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-cbdf0513-19c9-46d3-a731-8cb3a3a3987d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:25.917292 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cbdf0513-19c9-46d3-a731-8cb3a3a3987d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.917781 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cbdf0513-19c9-46d3-a731-8cb3a3a3987d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.918212 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cbdf0513-19c9-46d3-a731-8cb3a3a3987d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:25.918903 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cbdf0513-19c9-46d3-a731-8cb3a3a3987d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:25.919352 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cbdf0513-19c9-46d3-a731-8cb3a3a3987d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:25.919905 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cbdf0513-19c9-46d3-a731-8cb3a3a3987d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.048599 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-cbdf0513-19c9-46d3-a731-8cb3a3a3987d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:26.058705 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-cbdf0513-19c9-46d3-a731-8cb3a3a3987d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:26.060253 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-cbdf0513-19c9-46d3-a731-8cb3a3a3987d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:26.061420 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-cbdf0513-19c9-46d3-a731-8cb3a3a3987d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.155497 Aug 24 17:51:26.061983 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 190/405] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:25 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:26.137343 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Flavor limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:51:26.137761 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Image limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:51:26.138232 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Flavor pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:51:26.138653 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Image pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:51:26.139041 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:51:26.148295 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.148774 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.149200 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.149915 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.150364 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.150787 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.167822 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Getting quotas for project b9cd3cd0a9434f5ab0e1e1c52145beb2. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:51:26.171762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Getting quotas for user 4279761de1464be38860432a46a89074 and project b9cd3cd0a9434f5ab0e1e1c52145beb2. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:51:26.227772 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Going to run 1 instances... {{(pid=126994) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:51:26.229899 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f98aa1e4-b578-4c01-af7a-83866f47c27c',volume_size=None,volume_type=None)] {{(pid=126994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:51:26.347845 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ff9d596e-5b1a-4b2f-b2d0-1c4e8f0407df tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:26.348881 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ff9d596e-5b1a-4b2f-b2d0-1c4e8f0407df tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:26.355375 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ff9d596e-5b1a-4b2f-b2d0-1c4e8f0407df tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.355890 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ff9d596e-5b1a-4b2f-b2d0-1c4e8f0407df tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.356322 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ff9d596e-5b1a-4b2f-b2d0-1c4e8f0407df tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.357139 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ff9d596e-5b1a-4b2f-b2d0-1c4e8f0407df tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.357598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ff9d596e-5b1a-4b2f-b2d0-1c4e8f0407df tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.358021 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ff9d596e-5b1a-4b2f-b2d0-1c4e8f0407df tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.361267 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e2364a31-d97d-441b-989e-2171299277b5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730280 Aug 24 17:51:26.362782 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 216/406] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:51:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:51:26.374011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9a9897e7-59bf-4b13-86ac-1a26a301726e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:26.374968 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9a9897e7-59bf-4b13-86ac-1a26a301726e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:26.436885 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9a9897e7-59bf-4b13-86ac-1a26a301726e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:26.446223 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9a9897e7-59bf-4b13-86ac-1a26a301726e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1094 microversion: 2.1 time: 0.076028 Aug 24 17:51:26.446917 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 217/407] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:26 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:26.453260 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8d1dae7a-8bd8-43be-a0d3-410fd91b65aa tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:26.454168 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8d1dae7a-8bd8-43be-a0d3-410fd91b65aa tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:26.463136 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8d1dae7a-8bd8-43be-a0d3-410fd91b65aa tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.463870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8d1dae7a-8bd8-43be-a0d3-410fd91b65aa tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.464568 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8d1dae7a-8bd8-43be-a0d3-410fd91b65aa tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.465491 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8d1dae7a-8bd8-43be-a0d3-410fd91b65aa tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:26.466073 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8d1dae7a-8bd8-43be-a0d3-410fd91b65aa tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:26.466674 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8d1dae7a-8bd8-43be-a0d3-410fd91b65aa tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:26.543716 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ff9d596e-5b1a-4b2f-b2d0-1c4e8f0407df tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:26.552222 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ff9d596e-5b1a-4b2f-b2d0-1c4e8f0407df tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.209781 Aug 24 17:51:26.552788 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 191/408] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:26 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:26.607356 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8d1dae7a-8bd8-43be-a0d3-410fd91b65aa tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:26.616464 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8d1dae7a-8bd8-43be-a0d3-410fd91b65aa tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1513 microversion: 2.1 time: 0.168320 Aug 24 17:51:26.616997 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 218/409] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:26 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:27.084688 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-173c7422-3bf9-4d68-b281-4f54108c45ad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:27.085318 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-173c7422-3bf9-4d68-b281-4f54108c45ad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:27.091652 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-173c7422-3bf9-4d68-b281-4f54108c45ad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.092137 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-173c7422-3bf9-4d68-b281-4f54108c45ad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.092572 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-173c7422-3bf9-4d68-b281-4f54108c45ad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.093260 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-173c7422-3bf9-4d68-b281-4f54108c45ad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.093717 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-173c7422-3bf9-4d68-b281-4f54108c45ad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.094143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-173c7422-3bf9-4d68-b281-4f54108c45ad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.224750 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-173c7422-3bf9-4d68-b281-4f54108c45ad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.233559 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-173c7422-3bf9-4d68-b281-4f54108c45ad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.235293 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-173c7422-3bf9-4d68-b281-4f54108c45ad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.236520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-173c7422-3bf9-4d68-b281-4f54108c45ad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.156327 Aug 24 17:51:27.237107 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 192/410] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:27 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:27.466501 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-da39836e-b8b4-4c70-8e84-a2c85077d26a tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:27.467115 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-da39836e-b8b4-4c70-8e84-a2c85077d26a tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:27.474305 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-da39836e-b8b4-4c70-8e84-a2c85077d26a tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.474734 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-da39836e-b8b4-4c70-8e84-a2c85077d26a tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.475164 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-da39836e-b8b4-4c70-8e84-a2c85077d26a tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.475873 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-da39836e-b8b4-4c70-8e84-a2c85077d26a tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.476326 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-da39836e-b8b4-4c70-8e84-a2c85077d26a tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.476780 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-da39836e-b8b4-4c70-8e84-a2c85077d26a tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.537133 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-da39836e-b8b4-4c70-8e84-a2c85077d26a tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.544822 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-da39836e-b8b4-4c70-8e84-a2c85077d26a tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1144 microversion: 2.1 time: 0.082487 Aug 24 17:51:27.545464 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 219/411] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:27 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:27.572375 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-64a199d6-0b41-4677-bdbc-ad5063118183 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:27.572988 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-64a199d6-0b41-4677-bdbc-ad5063118183 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:27.579108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-64a199d6-0b41-4677-bdbc-ad5063118183 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.579629 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-64a199d6-0b41-4677-bdbc-ad5063118183 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.580067 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-64a199d6-0b41-4677-bdbc-ad5063118183 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.581267 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-64a199d6-0b41-4677-bdbc-ad5063118183 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.581750 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-64a199d6-0b41-4677-bdbc-ad5063118183 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.582172 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-64a199d6-0b41-4677-bdbc-ad5063118183 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.637311 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-23795a05-82c9-4898-8359-a1d55c906e5b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:27.637962 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-23795a05-82c9-4898-8359-a1d55c906e5b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:27.644669 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-23795a05-82c9-4898-8359-a1d55c906e5b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.645162 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-23795a05-82c9-4898-8359-a1d55c906e5b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.645612 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-23795a05-82c9-4898-8359-a1d55c906e5b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.646313 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-23795a05-82c9-4898-8359-a1d55c906e5b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:27.646773 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-23795a05-82c9-4898-8359-a1d55c906e5b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:27.647198 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-23795a05-82c9-4898-8359-a1d55c906e5b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:27.722727 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-64a199d6-0b41-4677-bdbc-ad5063118183 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.731047 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-64a199d6-0b41-4677-bdbc-ad5063118183 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.162351 Aug 24 17:51:27.731868 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 193/412] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:27 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:27.790137 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-23795a05-82c9-4898-8359-a1d55c906e5b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:27.798131 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-23795a05-82c9-4898-8359-a1d55c906e5b tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1513 microversion: 2.1 time: 0.164685 Aug 24 17:51:27.798901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 220/413] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:27 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:28.258730 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0d07be83-df34-47a6-a3ad-a73c245b86dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:28.260152 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0d07be83-df34-47a6-a3ad-a73c245b86dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:28.268645 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0d07be83-df34-47a6-a3ad-a73c245b86dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.269139 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0d07be83-df34-47a6-a3ad-a73c245b86dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.269577 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0d07be83-df34-47a6-a3ad-a73c245b86dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.270520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0d07be83-df34-47a6-a3ad-a73c245b86dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.270975 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0d07be83-df34-47a6-a3ad-a73c245b86dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.271399 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0d07be83-df34-47a6-a3ad-a73c245b86dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.415324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0d07be83-df34-47a6-a3ad-a73c245b86dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:28.423996 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0d07be83-df34-47a6-a3ad-a73c245b86dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:28.425510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0d07be83-df34-47a6-a3ad-a73c245b86dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:28.426664 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0d07be83-df34-47a6-a3ad-a73c245b86dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.171993 Aug 24 17:51:28.427222 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 194/414] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:28 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:28.567414 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3465b06f-7ff1-4fec-9459-876c559daaef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:28.568638 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3465b06f-7ff1-4fec-9459-876c559daaef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:28.579329 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3465b06f-7ff1-4fec-9459-876c559daaef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.582013 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3465b06f-7ff1-4fec-9459-876c559daaef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.583197 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3465b06f-7ff1-4fec-9459-876c559daaef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.584144 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3465b06f-7ff1-4fec-9459-876c559daaef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.593369 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3465b06f-7ff1-4fec-9459-876c559daaef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.594069 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3465b06f-7ff1-4fec-9459-876c559daaef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.742808 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3465b06f-7ff1-4fec-9459-876c559daaef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:28.754407 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-12dc5e24-50d3-4197-aa11-33846a49b373 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:28.755092 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-12dc5e24-50d3-4197-aa11-33846a49b373 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:28.756099 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3465b06f-7ff1-4fec-9459-876c559daaef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1192 microversion: 2.1 time: 0.194005 Aug 24 17:51:28.757189 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 221/415] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:28 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1192 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:28.775959 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-12dc5e24-50d3-4197-aa11-33846a49b373 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.777145 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-12dc5e24-50d3-4197-aa11-33846a49b373 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.777589 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-12dc5e24-50d3-4197-aa11-33846a49b373 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.778299 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-12dc5e24-50d3-4197-aa11-33846a49b373 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.778752 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-12dc5e24-50d3-4197-aa11-33846a49b373 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.779171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-12dc5e24-50d3-4197-aa11-33846a49b373 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.819731 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3a8856b5-b316-4b65-84e0-54b61a54f9b9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:28.820277 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3a8856b5-b316-4b65-84e0-54b61a54f9b9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:28.826441 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3a8856b5-b316-4b65-84e0-54b61a54f9b9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.827363 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3a8856b5-b316-4b65-84e0-54b61a54f9b9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.827363 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3a8856b5-b316-4b65-84e0-54b61a54f9b9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:28.829772 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3a8856b5-b316-4b65-84e0-54b61a54f9b9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:28.830217 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3a8856b5-b316-4b65-84e0-54b61a54f9b9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:28.831264 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3a8856b5-b316-4b65-84e0-54b61a54f9b9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.026225 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3a8856b5-b316-4b65-84e0-54b61a54f9b9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:29.028180 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-12dc5e24-50d3-4197-aa11-33846a49b373 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:29.036108 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3a8856b5-b316-4b65-84e0-54b61a54f9b9 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 200 len: 1513 microversion: 2.1 time: 0.220640 Aug 24 17:51:29.038403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-12dc5e24-50d3-4197-aa11-33846a49b373 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.289745 Aug 24 17:51:29.040463 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 195/416] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:28 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:29.049866 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 222/417] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:28 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:29.219722 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-a12f335d-92e7-47b2-a157-972b1d38d36f req-c5a5316e-d9c9-4be2-a51a-be39c47e3e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08638681-706c-45de-8b52-d9fb2559b56e", "name": "network-vif-deleted", "tag": "bce29b41-eda3-4cc3-afba-8e72c0691c36"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:29.240318 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-a12f335d-92e7-47b2-a157-972b1d38d36f req-c5a5316e-d9c9-4be2-a51a-be39c47e3e41 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.241104 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-a12f335d-92e7-47b2-a157-972b1d38d36f req-c5a5316e-d9c9-4be2-a51a-be39c47e3e41 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.241703 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-a12f335d-92e7-47b2-a157-972b1d38d36f req-c5a5316e-d9c9-4be2-a51a-be39c47e3e41 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.262299 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-a12f335d-92e7-47b2-a157-972b1d38d36f req-c5a5316e-d9c9-4be2-a51a-be39c47e3e41 service nova] Creating event network-vif-deleted:bce29b41-eda3-4cc3-afba-8e72c0691c36 for instance 08638681-706c-45de-8b52-d9fb2559b56e on hv-cinder-84052 Aug 24 17:51:29.268014 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-a12f335d-92e7-47b2-a157-972b1d38d36f req-c5a5316e-d9c9-4be2-a51a-be39c47e3e41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052115 Aug 24 17:51:29.268619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 196/418] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:29.449520 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5def5f84-c7a3-457e-ae8e-477315738b8b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:29.450110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5def5f84-c7a3-457e-ae8e-477315738b8b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:29.455992 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5def5f84-c7a3-457e-ae8e-477315738b8b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.456474 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5def5f84-c7a3-457e-ae8e-477315738b8b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.456901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5def5f84-c7a3-457e-ae8e-477315738b8b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.457589 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5def5f84-c7a3-457e-ae8e-477315738b8b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.458033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5def5f84-c7a3-457e-ae8e-477315738b8b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.458453 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5def5f84-c7a3-457e-ae8e-477315738b8b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.627776 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5def5f84-c7a3-457e-ae8e-477315738b8b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:29.640565 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5def5f84-c7a3-457e-ae8e-477315738b8b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:29.644686 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5def5f84-c7a3-457e-ae8e-477315738b8b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:29.648068 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5def5f84-c7a3-457e-ae8e-477315738b8b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.202540 Aug 24 17:51:29.650353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 223/419] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:29 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:29.778690 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0ce4888d-1b2a-4653-b5a1-24a894a1ab2c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:29.779526 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0ce4888d-1b2a-4653-b5a1-24a894a1ab2c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:29.787847 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ce4888d-1b2a-4653-b5a1-24a894a1ab2c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.788330 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ce4888d-1b2a-4653-b5a1-24a894a1ab2c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.788771 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ce4888d-1b2a-4653-b5a1-24a894a1ab2c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:29.789481 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ce4888d-1b2a-4653-b5a1-24a894a1ab2c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:29.789945 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ce4888d-1b2a-4653-b5a1-24a894a1ab2c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:29.790379 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ce4888d-1b2a-4653-b5a1-24a894a1ab2c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.058749 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-16954657-82d9-4252-8d9b-7bc914f484dd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:30.059756 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-16954657-82d9-4252-8d9b-7bc914f484dd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 08638681-706c-45de-8b52-d9fb2559b56e] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:30.067052 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16954657-82d9-4252-8d9b-7bc914f484dd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.067730 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16954657-82d9-4252-8d9b-7bc914f484dd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.068170 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16954657-82d9-4252-8d9b-7bc914f484dd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.068878 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16954657-82d9-4252-8d9b-7bc914f484dd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.069330 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16954657-82d9-4252-8d9b-7bc914f484dd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.069745 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16954657-82d9-4252-8d9b-7bc914f484dd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.085110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-16954657-82d9-4252-8d9b-7bc914f484dd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] HTTP exception thrown: Instance 08638681-706c-45de-8b52-d9fb2559b56e could not be found. Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-16954657-82d9-4252-8d9b-7bc914f484dd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Request method failure captured: Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e HTTP/1.1 Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmTHKTEIHCa3XiDtiiIYp2pfi1okZaFlaJ_emVxblupyGvjXCrrkmsnx6vseurxFPqje1RzDK5abe2fOhmA7MsOET9SA7BC1DT92f833TiHbnIxWVM5JCn9A38LVIMzg6_niDNq19Bh8zjp9KVrl88j_grpBPj08kmc-N5IDzq6c4P0 Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: b3b756a7bd444bf3aec562b2717f5623 Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-VolumesSnapshotTestJSON-439425440 Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:51:30.086924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:51:30.089051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3b756a7bd444bf3aec562b2717f5623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3b756a7bd444bf3aec562b2717f5623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3b756a7bd444bf3aec562b2717f5623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3b756a7bd444bf3aec562b2717f5623"}]}] Aug 24 17:51:30.089051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-VolumesSnapshotTestJSON-439425440 Aug 24 17:51:30.089051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: b3b756a7bd444bf3aec562b2717f5623 Aug 24 17:51:30.089051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-439425440 Aug 24 17:51:30.089051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-VolumesSnapshotTestJSON-439425440-project Aug 24 17:51:30.089051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:51:30.089051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:51:30.089051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 21fdd2fd30544e4e9e0bf184034106fa Aug 24 17:51:30.089051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-VolumesSnapshotTestJSON-439425440-project Aug 24 17:51:30.089051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:51:30.089051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 08638681-706c-45de-8b52-d9fb2559b56e could not be found. Aug 24 17:51:30.089051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '08638681-706c-45de-8b52-d9fb2559b56e'} Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08638681-706c-45de-8b52-d9fb2559b56e could not be found. Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:51:30.090019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08638681-706c-45de-8b52-d9fb2559b56e could not be found. Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08638681-706c-45de-8b52-d9fb2559b56e could not be found. Aug 24 17:51:30.091622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:51:30.092904 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-16954657-82d9-4252-8d9b-7bc914f484dd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Returning 404 to user: Instance 08638681-706c-45de-8b52-d9fb2559b56e could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:51:30.092904 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-16954657-82d9-4252-8d9b-7bc914f484dd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e" status: 404 len: 111 microversion: 2.1 time: 0.035364 Aug 24 17:51:30.092904 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 224/420] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:30 2022] GET /compute/v2.1/servers/08638681-706c-45de-8b52-d9fb2559b56e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:51:30.104640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-81b800d5-d73b-4ed1-9827-751871158948 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:30.105255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-81b800d5-d73b-4ed1-9827-751871158948 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:30.112400 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-81b800d5-d73b-4ed1-9827-751871158948 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.113166 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-81b800d5-d73b-4ed1-9827-751871158948 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.113767 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-81b800d5-d73b-4ed1-9827-751871158948 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.114643 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-81b800d5-d73b-4ed1-9827-751871158948 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.115247 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-81b800d5-d73b-4ed1-9827-751871158948 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.115846 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-81b800d5-d73b-4ed1-9827-751871158948 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.282166 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-81b800d5-d73b-4ed1-9827-751871158948 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.291754 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0ce4888d-1b2a-4653-b5a1-24a894a1ab2c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.292605 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-81b800d5-d73b-4ed1-9827-751871158948 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.195957 Aug 24 17:51:30.293592 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 225/421] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:30 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:30.300291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-e522dc03-eecd-4eb6-ad2a-c99a61aeabf2 req-f0d2e0f9-ab47-4f95-96cb-bc76e8880dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa859353-b309-4c9b-8f43-21b185b4f27d", "name": "network-vif-plugged", "status": "completed", "tag": "8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:30.314644 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0ce4888d-1b2a-4653-b5a1-24a894a1ab2c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.540148 Aug 24 17:51:30.327518 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-e522dc03-eecd-4eb6-ad2a-c99a61aeabf2 req-f0d2e0f9-ab47-4f95-96cb-bc76e8880dea service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.327518 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-e522dc03-eecd-4eb6-ad2a-c99a61aeabf2 req-f0d2e0f9-ab47-4f95-96cb-bc76e8880dea service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.327518 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-e522dc03-eecd-4eb6-ad2a-c99a61aeabf2 req-f0d2e0f9-ab47-4f95-96cb-bc76e8880dea service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.328532 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 197/422] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:29 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:30.336598 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-e522dc03-eecd-4eb6-ad2a-c99a61aeabf2 req-f0d2e0f9-ab47-4f95-96cb-bc76e8880dea service nova] Creating event network-vif-plugged:8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba for instance aa859353-b309-4c9b-8f43-21b185b4f27d on hv-cinder-84052 Aug 24 17:51:30.349533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-e522dc03-eecd-4eb6-ad2a-c99a61aeabf2 req-f0d2e0f9-ab47-4f95-96cb-bc76e8880dea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054495 Aug 24 17:51:30.350135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 226/423] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:30.611855 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-528cabad-5054-4eb1-99dc-5eb84c50ff42 req-7a93f241-58e4-4876-bb57-db6a5d7fde2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b47b8e-315b-4035-b274-e3d90094cea0", "tag": "685b75ea-eb05-4e07-8542-1938a960343d"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:30.625450 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-528cabad-5054-4eb1-99dc-5eb84c50ff42 req-7a93f241-58e4-4876-bb57-db6a5d7fde2c service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.626406 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-528cabad-5054-4eb1-99dc-5eb84c50ff42 req-7a93f241-58e4-4876-bb57-db6a5d7fde2c service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.627172 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-528cabad-5054-4eb1-99dc-5eb84c50ff42 req-7a93f241-58e4-4876-bb57-db6a5d7fde2c service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.640880 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-528cabad-5054-4eb1-99dc-5eb84c50ff42 req-7a93f241-58e4-4876-bb57-db6a5d7fde2c service nova] Creating event network-changed:685b75ea-eb05-4e07-8542-1938a960343d for instance 33b47b8e-315b-4035-b274-e3d90094cea0 on hv-cinder-84052 Aug 24 17:51:30.646525 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-528cabad-5054-4eb1-99dc-5eb84c50ff42 req-7a93f241-58e4-4876-bb57-db6a5d7fde2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040182 Aug 24 17:51:30.647201 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 198/424] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:30.675364 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d0a8be8d-ede1-4933-9bec-6625dca373bf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:30.676250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d0a8be8d-ede1-4933-9bec-6625dca373bf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:30.682372 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d0a8be8d-ede1-4933-9bec-6625dca373bf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.682872 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d0a8be8d-ede1-4933-9bec-6625dca373bf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.683310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d0a8be8d-ede1-4933-9bec-6625dca373bf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.684050 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d0a8be8d-ede1-4933-9bec-6625dca373bf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:30.684508 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d0a8be8d-ede1-4933-9bec-6625dca373bf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:30.684935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d0a8be8d-ede1-4933-9bec-6625dca373bf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:30.813646 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d0a8be8d-ede1-4933-9bec-6625dca373bf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.817787 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=100 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:30.823840 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d0a8be8d-ede1-4933-9bec-6625dca373bf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.825368 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d0a8be8d-ede1-4933-9bec-6625dca373bf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:30.826515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d0a8be8d-ede1-4933-9bec-6625dca373bf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.156003 Aug 24 17:51:30.827059 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 227/425] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:30 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:31.314235 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-76e2bfc4-6375-4fe8-a5b4-a27ccabcf3a8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:31.315526 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-76e2bfc4-6375-4fe8-a5b4-a27ccabcf3a8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:31.322005 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-76e2bfc4-6375-4fe8-a5b4-a27ccabcf3a8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.322480 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-76e2bfc4-6375-4fe8-a5b4-a27ccabcf3a8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.322900 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-76e2bfc4-6375-4fe8-a5b4-a27ccabcf3a8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.323605 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-76e2bfc4-6375-4fe8-a5b4-a27ccabcf3a8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.324052 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-76e2bfc4-6375-4fe8-a5b4-a27ccabcf3a8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.324465 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-76e2bfc4-6375-4fe8-a5b4-a27ccabcf3a8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.337448 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4e50a3f9-3184-4059-865c-e782b195b864 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:31.338432 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4e50a3f9-3184-4059-865c-e782b195b864 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:31.344550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e50a3f9-3184-4059-865c-e782b195b864 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.345042 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e50a3f9-3184-4059-865c-e782b195b864 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.345480 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e50a3f9-3184-4059-865c-e782b195b864 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.346184 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e50a3f9-3184-4059-865c-e782b195b864 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.346642 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e50a3f9-3184-4059-865c-e782b195b864 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.347066 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e50a3f9-3184-4059-865c-e782b195b864 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-76e2bfc4-6375-4fe8-a5b4-a27ccabcf3a8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:31.469721 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-76e2bfc4-6375-4fe8-a5b4-a27ccabcf3a8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.159600 Aug 24 17:51:31.470284 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 199/426] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:31 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:31.480453 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4e50a3f9-3184-4059-865c-e782b195b864 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:31.488583 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4e50a3f9-3184-4059-865c-e782b195b864 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.155033 Aug 24 17:51:31.489135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 228/427] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:31 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:31.849683 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-bc302693-972a-4e92-8ca1-dca668d02b54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:31.850295 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-bc302693-972a-4e92-8ca1-dca668d02b54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:31.856220 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc302693-972a-4e92-8ca1-dca668d02b54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.856702 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc302693-972a-4e92-8ca1-dca668d02b54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.857131 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc302693-972a-4e92-8ca1-dca668d02b54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.857812 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc302693-972a-4e92-8ca1-dca668d02b54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:31.858261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc302693-972a-4e92-8ca1-dca668d02b54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:31.858676 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc302693-972a-4e92-8ca1-dca668d02b54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:31.985688 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-bc302693-972a-4e92-8ca1-dca668d02b54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:31.994129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-bc302693-972a-4e92-8ca1-dca668d02b54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:31.995654 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-bc302693-972a-4e92-8ca1-dca668d02b54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:31.996810 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-bc302693-972a-4e92-8ca1-dca668d02b54 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.151017 Aug 24 17:51:31.997354 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 200/428] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:31 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:32.490174 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e71799b8-53cb-4c95-b91d-749afebfe2fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:32.490819 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e71799b8-53cb-4c95-b91d-749afebfe2fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:32.497299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e71799b8-53cb-4c95-b91d-749afebfe2fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.497780 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e71799b8-53cb-4c95-b91d-749afebfe2fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.498215 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e71799b8-53cb-4c95-b91d-749afebfe2fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.498898 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e71799b8-53cb-4c95-b91d-749afebfe2fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.499350 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e71799b8-53cb-4c95-b91d-749afebfe2fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.499799 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e71799b8-53cb-4c95-b91d-749afebfe2fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.509176 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-27c7fa7f-4d29-4084-afde-24e16e3a762b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:32.509789 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-27c7fa7f-4d29-4084-afde-24e16e3a762b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:32.516213 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-27c7fa7f-4d29-4084-afde-24e16e3a762b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.516699 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-27c7fa7f-4d29-4084-afde-24e16e3a762b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.517132 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-27c7fa7f-4d29-4084-afde-24e16e3a762b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.517823 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-27c7fa7f-4d29-4084-afde-24e16e3a762b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:32.518857 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-27c7fa7f-4d29-4084-afde-24e16e3a762b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:32.519280 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-27c7fa7f-4d29-4084-afde-24e16e3a762b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:32.632035 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e71799b8-53cb-4c95-b91d-749afebfe2fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:32.640375 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e71799b8-53cb-4c95-b91d-749afebfe2fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.154083 Aug 24 17:51:32.641053 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 229/429] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:32 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:32.655832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-27c7fa7f-4d29-4084-afde-24e16e3a762b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:32.663431 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-27c7fa7f-4d29-4084-afde-24e16e3a762b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.158062 Aug 24 17:51:32.664012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 201/430] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:32 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:33.019472 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1efbb543-25ca-4edd-aeb5-1b82977f0963 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:33.020096 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1efbb543-25ca-4edd-aeb5-1b82977f0963 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:33.023103 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:33.027019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1efbb543-25ca-4edd-aeb5-1b82977f0963 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.027505 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1efbb543-25ca-4edd-aeb5-1b82977f0963 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.027950 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1efbb543-25ca-4edd-aeb5-1b82977f0963 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.028628 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1efbb543-25ca-4edd-aeb5-1b82977f0963 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.029279 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1efbb543-25ca-4edd-aeb5-1b82977f0963 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.029706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1efbb543-25ca-4edd-aeb5-1b82977f0963 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.158046 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1efbb543-25ca-4edd-aeb5-1b82977f0963 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:33.167116 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1efbb543-25ca-4edd-aeb5-1b82977f0963 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:33.168651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1efbb543-25ca-4edd-aeb5-1b82977f0963 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:33.169794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1efbb543-25ca-4edd-aeb5-1b82977f0963 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.154233 Aug 24 17:51:33.170336 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 230/431] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:33 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:33.662351 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9054bb01-fb4b-4732-b80b-b2c95ee8d886 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:33.662916 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9054bb01-fb4b-4732-b80b-b2c95ee8d886 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:33.670080 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9054bb01-fb4b-4732-b80b-b2c95ee8d886 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.670563 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9054bb01-fb4b-4732-b80b-b2c95ee8d886 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.670995 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9054bb01-fb4b-4732-b80b-b2c95ee8d886 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.671707 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9054bb01-fb4b-4732-b80b-b2c95ee8d886 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.672163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9054bb01-fb4b-4732-b80b-b2c95ee8d886 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.672583 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9054bb01-fb4b-4732-b80b-b2c95ee8d886 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.683037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-84dd9f38-048d-482c-85f6-04b4fb311522 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:33.683676 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-84dd9f38-048d-482c-85f6-04b4fb311522 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:33.689988 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-84dd9f38-048d-482c-85f6-04b4fb311522 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.690473 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-84dd9f38-048d-482c-85f6-04b4fb311522 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.690899 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-84dd9f38-048d-482c-85f6-04b4fb311522 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.691614 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-84dd9f38-048d-482c-85f6-04b4fb311522 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:33.692072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-84dd9f38-048d-482c-85f6-04b4fb311522 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:33.692490 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-84dd9f38-048d-482c-85f6-04b4fb311522 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:33.828232 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-84dd9f38-048d-482c-85f6-04b4fb311522 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:33.836545 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-84dd9f38-048d-482c-85f6-04b4fb311522 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.157395 Aug 24 17:51:33.837112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 231/432] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:33 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:33.838439 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9054bb01-fb4b-4732-b80b-b2c95ee8d886 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:33.846749 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9054bb01-fb4b-4732-b80b-b2c95ee8d886 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.188397 Aug 24 17:51:33.847300 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 202/433] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:33 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:34.193673 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fd3fae9c-b357-4f85-8b1e-5c75ce484b05 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:34.194285 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-fd3fae9c-b357-4f85-8b1e-5c75ce484b05 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:34.200356 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fd3fae9c-b357-4f85-8b1e-5c75ce484b05 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.200847 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fd3fae9c-b357-4f85-8b1e-5c75ce484b05 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.201290 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fd3fae9c-b357-4f85-8b1e-5c75ce484b05 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.201980 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fd3fae9c-b357-4f85-8b1e-5c75ce484b05 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.202443 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fd3fae9c-b357-4f85-8b1e-5c75ce484b05 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.202872 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fd3fae9c-b357-4f85-8b1e-5c75ce484b05 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.328323 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fd3fae9c-b357-4f85-8b1e-5c75ce484b05 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:34.336942 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fd3fae9c-b357-4f85-8b1e-5c75ce484b05 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:34.338714 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fd3fae9c-b357-4f85-8b1e-5c75ce484b05 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:34.339911 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-fd3fae9c-b357-4f85-8b1e-5c75ce484b05 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.150646 Aug 24 17:51:34.340468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 232/434] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:34 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:34.857144 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4ace5418-8bb4-4d45-bca1-7c2ea179aac3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:34.857757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4ace5418-8bb4-4d45-bca1-7c2ea179aac3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:34.866604 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4ace5418-8bb4-4d45-bca1-7c2ea179aac3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.866796 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c83ae216-beab-4533-9a42-3f78c8dfbbea tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:34.867266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4ace5418-8bb4-4d45-bca1-7c2ea179aac3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.867366 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4ace5418-8bb4-4d45-bca1-7c2ea179aac3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.867452 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c83ae216-beab-4533-9a42-3f78c8dfbbea tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:34.868076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4ace5418-8bb4-4d45-bca1-7c2ea179aac3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.868531 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4ace5418-8bb4-4d45-bca1-7c2ea179aac3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.868954 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4ace5418-8bb4-4d45-bca1-7c2ea179aac3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.873719 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c83ae216-beab-4533-9a42-3f78c8dfbbea tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.874205 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c83ae216-beab-4533-9a42-3f78c8dfbbea tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.874640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c83ae216-beab-4533-9a42-3f78c8dfbbea tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:34.875330 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c83ae216-beab-4533-9a42-3f78c8dfbbea tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:34.875810 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c83ae216-beab-4533-9a42-3f78c8dfbbea tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:34.876226 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c83ae216-beab-4533-9a42-3f78c8dfbbea tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.012573 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c83ae216-beab-4533-9a42-3f78c8dfbbea tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:35.020319 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c83ae216-beab-4533-9a42-3f78c8dfbbea tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1258 microversion: 2.1 time: 0.157481 Aug 24 17:51:35.020894 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 233/435] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:34 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:35.078373 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4ace5418-8bb4-4d45-bca1-7c2ea179aac3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:35.086688 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4ace5418-8bb4-4d45-bca1-7c2ea179aac3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.233438 Aug 24 17:51:35.087258 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 203/436] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:34 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:35.362017 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6a7dd87c-24ce-4049-a95b-fd4376f64114 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:35.362637 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-6a7dd87c-24ce-4049-a95b-fd4376f64114 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:35.368625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6a7dd87c-24ce-4049-a95b-fd4376f64114 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:35.369111 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6a7dd87c-24ce-4049-a95b-fd4376f64114 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:35.369547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6a7dd87c-24ce-4049-a95b-fd4376f64114 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.370241 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6a7dd87c-24ce-4049-a95b-fd4376f64114 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:35.370725 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6a7dd87c-24ce-4049-a95b-fd4376f64114 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:35.371150 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6a7dd87c-24ce-4049-a95b-fd4376f64114 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:35.496844 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6a7dd87c-24ce-4049-a95b-fd4376f64114 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:35.505854 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6a7dd87c-24ce-4049-a95b-fd4376f64114 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:35.507373 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6a7dd87c-24ce-4049-a95b-fd4376f64114 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:35.508538 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6a7dd87c-24ce-4049-a95b-fd4376f64114 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.150491 Aug 24 17:51:35.509092 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 234/437] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:35 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:36.041103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-bb10e785-5a2e-4543-aef4-de628f221f81 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:36.041713 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-bb10e785-5a2e-4543-aef4-de628f221f81 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:36.048373 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bb10e785-5a2e-4543-aef4-de628f221f81 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.048856 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bb10e785-5a2e-4543-aef4-de628f221f81 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.049469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bb10e785-5a2e-4543-aef4-de628f221f81 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.050675 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bb10e785-5a2e-4543-aef4-de628f221f81 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.051129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bb10e785-5a2e-4543-aef4-de628f221f81 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.051576 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bb10e785-5a2e-4543-aef4-de628f221f81 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.071828 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=100 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:36.108533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b0b10322-4d0d-4953-99e3-23a9e978804c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:36.109145 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b0b10322-4d0d-4953-99e3-23a9e978804c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:36.116133 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b0b10322-4d0d-4953-99e3-23a9e978804c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.116878 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b0b10322-4d0d-4953-99e3-23a9e978804c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.117553 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b0b10322-4d0d-4953-99e3-23a9e978804c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.118457 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b0b10322-4d0d-4953-99e3-23a9e978804c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.119109 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b0b10322-4d0d-4953-99e3-23a9e978804c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.119743 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b0b10322-4d0d-4953-99e3-23a9e978804c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.158410 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:36.202764 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-bb10e785-5a2e-4543-aef4-de628f221f81 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:36.210749 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-bb10e785-5a2e-4543-aef4-de628f221f81 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1442 microversion: 2.1 time: 0.173476 Aug 24 17:51:36.211324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 204/438] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:36 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1442 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:36.232698 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a8c16a29-2988-452f-9c9e-f208593bb70f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:36.233510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a8c16a29-2988-452f-9c9e-f208593bb70f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:36.240581 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a8c16a29-2988-452f-9c9e-f208593bb70f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.241276 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a8c16a29-2988-452f-9c9e-f208593bb70f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.241908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a8c16a29-2988-452f-9c9e-f208593bb70f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.242618 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a8c16a29-2988-452f-9c9e-f208593bb70f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.243070 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a8c16a29-2988-452f-9c9e-f208593bb70f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.243740 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a8c16a29-2988-452f-9c9e-f208593bb70f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.260323 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b0b10322-4d0d-4953-99e3-23a9e978804c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:36.269945 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b0b10322-4d0d-4953-99e3-23a9e978804c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.165196 Aug 24 17:51:36.270512 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 235/439] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:36 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:36.379627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a8c16a29-2988-452f-9c9e-f208593bb70f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:36.387286 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a8c16a29-2988-452f-9c9e-f208593bb70f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1442 microversion: 2.1 time: 0.159252 Aug 24 17:51:36.387868 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 205/440] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:36 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:36.531786 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-11fb951e-c041-402c-98fa-82fe7282e441 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:36.532546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-11fb951e-c041-402c-98fa-82fe7282e441 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:36.536153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=8 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:36.540569 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-11fb951e-c041-402c-98fa-82fe7282e441 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.541132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-11fb951e-c041-402c-98fa-82fe7282e441 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.541731 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-11fb951e-c041-402c-98fa-82fe7282e441 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.542610 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-11fb951e-c041-402c-98fa-82fe7282e441 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:36.543068 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-11fb951e-c041-402c-98fa-82fe7282e441 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:36.543515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-11fb951e-c041-402c-98fa-82fe7282e441 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:36.678842 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-11fb951e-c041-402c-98fa-82fe7282e441 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:36.687540 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-11fb951e-c041-402c-98fa-82fe7282e441 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:36.689067 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-11fb951e-c041-402c-98fa-82fe7282e441 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:36.690268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-11fb951e-c041-402c-98fa-82fe7282e441 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.162444 Aug 24 17:51:36.690824 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 236/441] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:36 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:37.290904 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b8e06be5-4472-48cf-ae10-d1d9c094b905 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:37.291633 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b8e06be5-4472-48cf-ae10-d1d9c094b905 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:37.297973 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8e06be5-4472-48cf-ae10-d1d9c094b905 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:37.298456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8e06be5-4472-48cf-ae10-d1d9c094b905 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:37.298894 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8e06be5-4472-48cf-ae10-d1d9c094b905 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:37.300124 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8e06be5-4472-48cf-ae10-d1d9c094b905 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:37.300581 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8e06be5-4472-48cf-ae10-d1d9c094b905 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:37.301006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8e06be5-4472-48cf-ae10-d1d9c094b905 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:37.503362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b8e06be5-4472-48cf-ae10-d1d9c094b905 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:37.511756 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b8e06be5-4472-48cf-ae10-d1d9c094b905 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.224667 Aug 24 17:51:37.512336 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 206/442] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:37 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:37.713335 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5d400dc5-b0d3-4fff-bacb-dca4ef254216 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:37.714073 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5d400dc5-b0d3-4fff-bacb-dca4ef254216 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:37.720690 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5d400dc5-b0d3-4fff-bacb-dca4ef254216 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:37.721253 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5d400dc5-b0d3-4fff-bacb-dca4ef254216 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:37.722269 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5d400dc5-b0d3-4fff-bacb-dca4ef254216 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:37.723034 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5d400dc5-b0d3-4fff-bacb-dca4ef254216 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:37.723510 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5d400dc5-b0d3-4fff-bacb-dca4ef254216 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:37.723937 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5d400dc5-b0d3-4fff-bacb-dca4ef254216 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:37.853370 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5d400dc5-b0d3-4fff-bacb-dca4ef254216 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:37.862775 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5d400dc5-b0d3-4fff-bacb-dca4ef254216 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:37.864405 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5d400dc5-b0d3-4fff-bacb-dca4ef254216 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:37.865651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5d400dc5-b0d3-4fff-bacb-dca4ef254216 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.156583 Aug 24 17:51:37.866283 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 237/443] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:37 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:38.440321 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-e44a9313-29c1-4e5f-a2b9-f4904ca5ee39 req-a8df8dfe-4a38-4872-8317-20394bdd942b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa859353-b309-4c9b-8f43-21b185b4f27d", "tag": "8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:38.450172 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-e44a9313-29c1-4e5f-a2b9-f4904ca5ee39 req-a8df8dfe-4a38-4872-8317-20394bdd942b service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.450651 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-e44a9313-29c1-4e5f-a2b9-f4904ca5ee39 req-a8df8dfe-4a38-4872-8317-20394bdd942b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.451082 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-e44a9313-29c1-4e5f-a2b9-f4904ca5ee39 req-a8df8dfe-4a38-4872-8317-20394bdd942b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.464183 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-e44a9313-29c1-4e5f-a2b9-f4904ca5ee39 req-a8df8dfe-4a38-4872-8317-20394bdd942b service nova] Creating event network-changed:8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba for instance aa859353-b309-4c9b-8f43-21b185b4f27d on hv-cinder-84052 Aug 24 17:51:38.469146 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-e44a9313-29c1-4e5f-a2b9-f4904ca5ee39 req-a8df8dfe-4a38-4872-8317-20394bdd942b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032574 Aug 24 17:51:38.469725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 207/444] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:38.532911 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f04e7ba1-2a8a-4b9c-9e47-e3a2f9bb231c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:38.533705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f04e7ba1-2a8a-4b9c-9e47-e3a2f9bb231c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:38.540427 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f04e7ba1-2a8a-4b9c-9e47-e3a2f9bb231c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.540907 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f04e7ba1-2a8a-4b9c-9e47-e3a2f9bb231c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.541339 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f04e7ba1-2a8a-4b9c-9e47-e3a2f9bb231c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.542052 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f04e7ba1-2a8a-4b9c-9e47-e3a2f9bb231c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.542504 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f04e7ba1-2a8a-4b9c-9e47-e3a2f9bb231c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.542920 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f04e7ba1-2a8a-4b9c-9e47-e3a2f9bb231c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.682714 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f04e7ba1-2a8a-4b9c-9e47-e3a2f9bb231c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:38.690469 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f04e7ba1-2a8a-4b9c-9e47-e3a2f9bb231c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.161482 Aug 24 17:51:38.691283 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 238/445] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:38 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:38.889876 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-761f9663-2a20-4923-aff4-8040083b0e15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:38.890790 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-761f9663-2a20-4923-aff4-8040083b0e15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:38.898011 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-761f9663-2a20-4923-aff4-8040083b0e15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.898621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-761f9663-2a20-4923-aff4-8040083b0e15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.899542 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-761f9663-2a20-4923-aff4-8040083b0e15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:38.900453 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-761f9663-2a20-4923-aff4-8040083b0e15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:38.901014 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-761f9663-2a20-4923-aff4-8040083b0e15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:38.901509 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-761f9663-2a20-4923-aff4-8040083b0e15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:39.066812 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-761f9663-2a20-4923-aff4-8040083b0e15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:39.076830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-761f9663-2a20-4923-aff4-8040083b0e15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:39.079131 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-761f9663-2a20-4923-aff4-8040083b0e15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:39.080945 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-761f9663-2a20-4923-aff4-8040083b0e15 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.195424 Aug 24 17:51:39.082447 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 208/446] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:38 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:39.107631 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1056355633", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "networks": [{"uuid": "f9720aec-6384-45df-9a98-9c757a2487a4"}]}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:39.167562 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.network.neutron [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] validate_networks() for [('f9720aec-6384-45df-9a98-9c757a2487a4', None, None, None, None, None)] {{(pid=126994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:51:39.713321 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2fa42284-f691-446b-aac5-dd5160dffef0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:39.713935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2fa42284-f691-446b-aac5-dd5160dffef0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:39.716563 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:39.722409 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2fa42284-f691-446b-aac5-dd5160dffef0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:39.722897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2fa42284-f691-446b-aac5-dd5160dffef0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:39.723331 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2fa42284-f691-446b-aac5-dd5160dffef0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:39.724067 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2fa42284-f691-446b-aac5-dd5160dffef0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:39.725163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2fa42284-f691-446b-aac5-dd5160dffef0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:39.725593 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2fa42284-f691-446b-aac5-dd5160dffef0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:39.829784 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Flavor limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:51:39.830421 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Image limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:51:39.831454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Flavor pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:51:39.831880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Image pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:51:39.832287 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:51:39.841178 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:39.841859 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:39.842353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:39.843079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:39.843549 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:39.843965 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:39.859195 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2fa42284-f691-446b-aac5-dd5160dffef0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:39.860986 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Getting quotas for project b3b756a7bd444bf3aec562b2717f5623. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:51:39.864997 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Getting quotas for user 21fdd2fd30544e4e9e0bf184034106fa and project b3b756a7bd444bf3aec562b2717f5623. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:51:39.868059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2fa42284-f691-446b-aac5-dd5160dffef0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.158979 Aug 24 17:51:39.868736 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 209/447] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:39 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:39.875835 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Going to run 1 instances... {{(pid=126994) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:51:39.878143 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:51:39.923007 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-700dc64d-39fa-4d9a-91b4-4ce2bd74ae4f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819250 Aug 24 17:51:39.923659 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 239/448] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:51:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:51:39.934154 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1ac782ee-f26d-4e0a-9152-5f7a9cfbbd48 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:39.934765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1ac782ee-f26d-4e0a-9152-5f7a9cfbbd48 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:39.991089 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1ac782ee-f26d-4e0a-9152-5f7a9cfbbd48 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:39.997986 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1ac782ee-f26d-4e0a-9152-5f7a9cfbbd48 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1219 microversion: 2.1 time: 0.067561 Aug 24 17:51:39.998543 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 210/449] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:39 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:40.103390 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b7c167fe-59d3-4ac0-b368-a0adfe609165 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:40.104372 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b7c167fe-59d3-4ac0-b368-a0adfe609165 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:40.110180 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b7c167fe-59d3-4ac0-b368-a0adfe609165 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.110769 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b7c167fe-59d3-4ac0-b368-a0adfe609165 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.111235 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b7c167fe-59d3-4ac0-b368-a0adfe609165 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:40.112076 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b7c167fe-59d3-4ac0-b368-a0adfe609165 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.112707 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b7c167fe-59d3-4ac0-b368-a0adfe609165 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.113144 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b7c167fe-59d3-4ac0-b368-a0adfe609165 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:40.248507 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b7c167fe-59d3-4ac0-b368-a0adfe609165 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:40.258432 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b7c167fe-59d3-4ac0-b368-a0adfe609165 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:40.260127 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b7c167fe-59d3-4ac0-b368-a0adfe609165 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:40.261430 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b7c167fe-59d3-4ac0-b368-a0adfe609165 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.161835 Aug 24 17:51:40.261921 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 240/450] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:40 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:40.836662 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-5d43b433-8222-4ee3-b154-72b5581e7896 req-a1cd69bc-4343-4c85-9966-f318c25c9d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11705238-e9d4-4c1e-ab49-d5a27eb4df4c", "name": "network-vif-plugged", "status": "completed", "tag": "41c4ee25-50fb-45d7-9866-1d83514f02d5"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:40.852794 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-5d43b433-8222-4ee3-b154-72b5581e7896 req-a1cd69bc-4343-4c85-9966-f318c25c9d0c service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.853273 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-5d43b433-8222-4ee3-b154-72b5581e7896 req-a1cd69bc-4343-4c85-9966-f318c25c9d0c service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.853877 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-5d43b433-8222-4ee3-b154-72b5581e7896 req-a1cd69bc-4343-4c85-9966-f318c25c9d0c service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:40.866200 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-5d43b433-8222-4ee3-b154-72b5581e7896 req-a1cd69bc-4343-4c85-9966-f318c25c9d0c service nova] Creating event network-vif-plugged:41c4ee25-50fb-45d7-9866-1d83514f02d5 for instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c on hv-cinder-84052 Aug 24 17:51:40.873475 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-5d43b433-8222-4ee3-b154-72b5581e7896 req-a1cd69bc-4343-4c85-9966-f318c25c9d0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041128 Aug 24 17:51:40.874071 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 211/451] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:40.889448 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-78f8919d-f6e5-449b-9a84-9a8fdba9de9c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:40.890126 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-78f8919d-f6e5-449b-9a84-9a8fdba9de9c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:40.897270 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-78f8919d-f6e5-449b-9a84-9a8fdba9de9c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.897812 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-78f8919d-f6e5-449b-9a84-9a8fdba9de9c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.898245 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-78f8919d-f6e5-449b-9a84-9a8fdba9de9c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:40.898949 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-78f8919d-f6e5-449b-9a84-9a8fdba9de9c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:40.899402 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-78f8919d-f6e5-449b-9a84-9a8fdba9de9c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:40.900483 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-78f8919d-f6e5-449b-9a84-9a8fdba9de9c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:41.019204 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-58681d78-b5bf-4cfe-84a0-b204e238637f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:41.019939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-58681d78-b5bf-4cfe-84a0-b204e238637f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:41.025973 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58681d78-b5bf-4cfe-84a0-b204e238637f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:41.026456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58681d78-b5bf-4cfe-84a0-b204e238637f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:41.026885 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58681d78-b5bf-4cfe-84a0-b204e238637f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:41.027663 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58681d78-b5bf-4cfe-84a0-b204e238637f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:41.028106 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58681d78-b5bf-4cfe-84a0-b204e238637f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:41.028700 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58681d78-b5bf-4cfe-84a0-b204e238637f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:41.067948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-78f8919d-f6e5-449b-9a84-9a8fdba9de9c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:41.075750 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-78f8919d-f6e5-449b-9a84-9a8fdba9de9c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.190675 Aug 24 17:51:41.078449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 241/452] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:40 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:41.097245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-58681d78-b5bf-4cfe-84a0-b204e238637f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:41.104892 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-58681d78-b5bf-4cfe-84a0-b204e238637f tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1289 microversion: 2.1 time: 0.090511 Aug 24 17:51:41.105446 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 212/453] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:41 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:41.285152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5562939f-dc70-47e1-9801-9429f9056754 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:41.285701 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5562939f-dc70-47e1-9801-9429f9056754 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:41.292057 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5562939f-dc70-47e1-9801-9429f9056754 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:41.292545 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5562939f-dc70-47e1-9801-9429f9056754 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:41.292986 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5562939f-dc70-47e1-9801-9429f9056754 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:41.293675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5562939f-dc70-47e1-9801-9429f9056754 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:41.294131 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5562939f-dc70-47e1-9801-9429f9056754 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:41.294556 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5562939f-dc70-47e1-9801-9429f9056754 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:41.423628 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5562939f-dc70-47e1-9801-9429f9056754 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:41.432262 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5562939f-dc70-47e1-9801-9429f9056754 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:41.433774 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5562939f-dc70-47e1-9801-9429f9056754 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:41.434934 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5562939f-dc70-47e1-9801-9429f9056754 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.153883 Aug 24 17:51:41.435504 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 242/454] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:41 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:42.096161 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6bd24bdb-5497-4bff-abfc-41e8f860a15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:42.096803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6bd24bdb-5497-4bff-abfc-41e8f860a15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:42.106121 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6bd24bdb-5497-4bff-abfc-41e8f860a15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:42.106682 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6bd24bdb-5497-4bff-abfc-41e8f860a15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:42.107183 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6bd24bdb-5497-4bff-abfc-41e8f860a15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:42.107972 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6bd24bdb-5497-4bff-abfc-41e8f860a15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:42.108492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6bd24bdb-5497-4bff-abfc-41e8f860a15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:42.108997 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6bd24bdb-5497-4bff-abfc-41e8f860a15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:42.125765 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e3195f19-7050-43f7-a7ce-f2af98b9c8c4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:42.126789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e3195f19-7050-43f7-a7ce-f2af98b9c8c4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:42.138467 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e3195f19-7050-43f7-a7ce-f2af98b9c8c4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:42.139041 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e3195f19-7050-43f7-a7ce-f2af98b9c8c4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:42.139571 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e3195f19-7050-43f7-a7ce-f2af98b9c8c4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:42.140336 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e3195f19-7050-43f7-a7ce-f2af98b9c8c4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:42.140869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e3195f19-7050-43f7-a7ce-f2af98b9c8c4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:42.141358 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e3195f19-7050-43f7-a7ce-f2af98b9c8c4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:42.295570 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6bd24bdb-5497-4bff-abfc-41e8f860a15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:42.304620 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6bd24bdb-5497-4bff-abfc-41e8f860a15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.212215 Aug 24 17:51:42.305364 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 213/455] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:42 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:42.363990 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e3195f19-7050-43f7-a7ce-f2af98b9c8c4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:42.371642 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e3195f19-7050-43f7-a7ce-f2af98b9c8c4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1319 microversion: 2.1 time: 0.249553 Aug 24 17:51:42.372195 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 243/456] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:42 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:42.458366 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2a9fa0c2-b5f0-43ab-b3d3-66f10a7a6d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:42.459036 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2a9fa0c2-b5f0-43ab-b3d3-66f10a7a6d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:42.465314 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a9fa0c2-b5f0-43ab-b3d3-66f10a7a6d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:42.465797 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a9fa0c2-b5f0-43ab-b3d3-66f10a7a6d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:42.466232 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a9fa0c2-b5f0-43ab-b3d3-66f10a7a6d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:42.466925 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a9fa0c2-b5f0-43ab-b3d3-66f10a7a6d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:42.467382 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a9fa0c2-b5f0-43ab-b3d3-66f10a7a6d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:42.467835 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a9fa0c2-b5f0-43ab-b3d3-66f10a7a6d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:42.596295 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2a9fa0c2-b5f0-43ab-b3d3-66f10a7a6d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:42.605598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2a9fa0c2-b5f0-43ab-b3d3-66f10a7a6d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:42.607097 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2a9fa0c2-b5f0-43ab-b3d3-66f10a7a6d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:42.608273 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2a9fa0c2-b5f0-43ab-b3d3-66f10a7a6d62 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.153845 Aug 24 17:51:42.608826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 214/457] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:42 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:43.163492 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-24d122ba-ccdf-4629-8ab7-986e20c8dabc req-377d0222-760f-47e1-88d9-831173662e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a7d17d-7ecc-41be-82ac-5830631987db", "tag": "60dea019-bcb1-455e-b394-85dd4c545f26"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:43.173390 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-24d122ba-ccdf-4629-8ab7-986e20c8dabc req-377d0222-760f-47e1-88d9-831173662e1b service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:43.174099 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-24d122ba-ccdf-4629-8ab7-986e20c8dabc req-377d0222-760f-47e1-88d9-831173662e1b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:43.174532 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-24d122ba-ccdf-4629-8ab7-986e20c8dabc req-377d0222-760f-47e1-88d9-831173662e1b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:43.185670 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-24d122ba-ccdf-4629-8ab7-986e20c8dabc req-377d0222-760f-47e1-88d9-831173662e1b service nova] Creating event network-changed:60dea019-bcb1-455e-b394-85dd4c545f26 for instance 95a7d17d-7ecc-41be-82ac-5830631987db on hv-cinder-84052 Aug 24 17:51:43.191060 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-24d122ba-ccdf-4629-8ab7-986e20c8dabc req-377d0222-760f-47e1-88d9-831173662e1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030876 Aug 24 17:51:43.191689 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 244/458] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:43.325491 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5c0c224f-51b3-48d3-9da9-5b677dafef63 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:43.326073 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5c0c224f-51b3-48d3-9da9-5b677dafef63 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:43.332540 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5c0c224f-51b3-48d3-9da9-5b677dafef63 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:43.333051 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5c0c224f-51b3-48d3-9da9-5b677dafef63 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:43.333485 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5c0c224f-51b3-48d3-9da9-5b677dafef63 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:43.334182 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5c0c224f-51b3-48d3-9da9-5b677dafef63 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:43.334633 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5c0c224f-51b3-48d3-9da9-5b677dafef63 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:43.335050 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5c0c224f-51b3-48d3-9da9-5b677dafef63 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:43.393705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4eb0359e-3a7e-4be9-9ae4-8da1f34b3bdd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:43.394411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4eb0359e-3a7e-4be9-9ae4-8da1f34b3bdd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:43.400590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4eb0359e-3a7e-4be9-9ae4-8da1f34b3bdd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:43.401082 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4eb0359e-3a7e-4be9-9ae4-8da1f34b3bdd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:43.401707 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4eb0359e-3a7e-4be9-9ae4-8da1f34b3bdd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:43.402408 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4eb0359e-3a7e-4be9-9ae4-8da1f34b3bdd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:43.402864 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4eb0359e-3a7e-4be9-9ae4-8da1f34b3bdd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:43.403284 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4eb0359e-3a7e-4be9-9ae4-8da1f34b3bdd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:43.478064 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-5c0c224f-51b3-48d3-9da9-5b677dafef63 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:43.486293 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5c0c224f-51b3-48d3-9da9-5b677dafef63 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.164649 Aug 24 17:51:43.487927 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 215/459] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:43 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:43.623003 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4eb0359e-3a7e-4be9-9ae4-8da1f34b3bdd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:43.626649 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=100 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:43.630716 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a2cc81d0-602c-4517-883a-ac17de0d3e13 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:43.631329 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a2cc81d0-602c-4517-883a-ac17de0d3e13 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:43.632522 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4eb0359e-3a7e-4be9-9ae4-8da1f34b3bdd tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1319 microversion: 2.1 time: 0.243486 Aug 24 17:51:43.633092 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 245/460] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:43 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:43.637306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a2cc81d0-602c-4517-883a-ac17de0d3e13 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:43.637784 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a2cc81d0-602c-4517-883a-ac17de0d3e13 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:43.638217 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a2cc81d0-602c-4517-883a-ac17de0d3e13 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:43.638903 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a2cc81d0-602c-4517-883a-ac17de0d3e13 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:43.639356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a2cc81d0-602c-4517-883a-ac17de0d3e13 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:43.639812 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a2cc81d0-602c-4517-883a-ac17de0d3e13 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:43.779119 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a2cc81d0-602c-4517-883a-ac17de0d3e13 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:43.788550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a2cc81d0-602c-4517-883a-ac17de0d3e13 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:43.790108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a2cc81d0-602c-4517-883a-ac17de0d3e13 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:43.791252 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a2cc81d0-602c-4517-883a-ac17de0d3e13 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1807 microversion: 2.20 time: 0.165011 Aug 24 17:51:43.791840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 216/461] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:43 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:51:44.508769 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0b2e7eb8-3a0d-4f40-87da-a467f3103dd9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:44.509378 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0b2e7eb8-3a0d-4f40-87da-a467f3103dd9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:44.515969 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0b2e7eb8-3a0d-4f40-87da-a467f3103dd9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.516452 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0b2e7eb8-3a0d-4f40-87da-a467f3103dd9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.516883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0b2e7eb8-3a0d-4f40-87da-a467f3103dd9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.517564 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0b2e7eb8-3a0d-4f40-87da-a467f3103dd9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.518012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0b2e7eb8-3a0d-4f40-87da-a467f3103dd9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.519064 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0b2e7eb8-3a0d-4f40-87da-a467f3103dd9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.653410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ce78c7ae-a78c-43c6-9c84-efb2fc2857fc tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:44.654025 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ce78c7ae-a78c-43c6-9c84-efb2fc2857fc tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:44.654306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0b2e7eb8-3a0d-4f40-87da-a467f3103dd9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:44.660065 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ce78c7ae-a78c-43c6-9c84-efb2fc2857fc tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.660553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ce78c7ae-a78c-43c6-9c84-efb2fc2857fc tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.660985 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ce78c7ae-a78c-43c6-9c84-efb2fc2857fc tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.661676 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ce78c7ae-a78c-43c6-9c84-efb2fc2857fc tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.662079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0b2e7eb8-3a0d-4f40-87da-a467f3103dd9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.157204 Aug 24 17:51:44.662186 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ce78c7ae-a78c-43c6-9c84-efb2fc2857fc tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.662530 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ce78c7ae-a78c-43c6-9c84-efb2fc2857fc tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.662645 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 246/462] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:44 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:44.796890 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ce78c7ae-a78c-43c6-9c84-efb2fc2857fc tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:44.805416 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ce78c7ae-a78c-43c6-9c84-efb2fc2857fc tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1319 microversion: 2.1 time: 0.156426 Aug 24 17:51:44.805985 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 217/463] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:44 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:44.816524 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-21ece231-7c71-486b-b2ab-c7fdd32ed983 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:44.817469 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-21ece231-7c71-486b-b2ab-c7fdd32ed983 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:44.823669 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21ece231-7c71-486b-b2ab-c7fdd32ed983 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.824160 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21ece231-7c71-486b-b2ab-c7fdd32ed983 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.824598 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21ece231-7c71-486b-b2ab-c7fdd32ed983 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.825293 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21ece231-7c71-486b-b2ab-c7fdd32ed983 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.825752 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21ece231-7c71-486b-b2ab-c7fdd32ed983 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.826183 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21ece231-7c71-486b-b2ab-c7fdd32ed983 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.871079 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-5d53082c-2f63-427d-90f6-8ade5f8159b7 req-2d168b1d-7b49-4ff2-b3a2-5726ff621b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b47b8e-315b-4035-b274-e3d90094cea0", "name": "network-vif-plugged", "status": "completed", "tag": "685b75ea-eb05-4e07-8542-1938a960343d"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:44.882020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-5d53082c-2f63-427d-90f6-8ade5f8159b7 req-2d168b1d-7b49-4ff2-b3a2-5726ff621b7e service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:44.882582 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-5d53082c-2f63-427d-90f6-8ade5f8159b7 req-2d168b1d-7b49-4ff2-b3a2-5726ff621b7e service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:44.883081 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-5d53082c-2f63-427d-90f6-8ade5f8159b7 req-2d168b1d-7b49-4ff2-b3a2-5726ff621b7e service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:44.894935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-5d53082c-2f63-427d-90f6-8ade5f8159b7 req-2d168b1d-7b49-4ff2-b3a2-5726ff621b7e service nova] Creating event network-vif-plugged:685b75ea-eb05-4e07-8542-1938a960343d for instance 33b47b8e-315b-4035-b274-e3d90094cea0 on hv-cinder-84052 Aug 24 17:51:44.899930 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-5d53082c-2f63-427d-90f6-8ade5f8159b7 req-2d168b1d-7b49-4ff2-b3a2-5726ff621b7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032496 Aug 24 17:51:44.900912 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 218/464] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:44.961489 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-21ece231-7c71-486b-b2ab-c7fdd32ed983 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:44.970394 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-21ece231-7c71-486b-b2ab-c7fdd32ed983 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:44.971925 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-21ece231-7c71-486b-b2ab-c7fdd32ed983 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:44.973081 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-21ece231-7c71-486b-b2ab-c7fdd32ed983 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1794 microversion: 2.20 time: 0.161228 Aug 24 17:51:44.973725 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 247/465] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:51:44 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1794 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:51:45.683090 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5b614108-2d80-405b-a652-2e269e45f31f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:45.683879 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5b614108-2d80-405b-a652-2e269e45f31f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:45.690216 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b614108-2d80-405b-a652-2e269e45f31f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:45.690704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b614108-2d80-405b-a652-2e269e45f31f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:45.691323 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b614108-2d80-405b-a652-2e269e45f31f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:45.692050 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b614108-2d80-405b-a652-2e269e45f31f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:45.693215 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b614108-2d80-405b-a652-2e269e45f31f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:45.693215 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b614108-2d80-405b-a652-2e269e45f31f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:45.827065 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-607f6c06-da71-4932-8474-2077e6a74201 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:45.827575 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-607f6c06-da71-4932-8474-2077e6a74201 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:45.838554 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-607f6c06-da71-4932-8474-2077e6a74201 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:45.839340 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-607f6c06-da71-4932-8474-2077e6a74201 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:45.840783 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-607f6c06-da71-4932-8474-2077e6a74201 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:45.841659 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-607f6c06-da71-4932-8474-2077e6a74201 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:45.842498 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-607f6c06-da71-4932-8474-2077e6a74201 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:45.843585 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-607f6c06-da71-4932-8474-2077e6a74201 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:45.876748 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-5b614108-2d80-405b-a652-2e269e45f31f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:45.885294 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5b614108-2d80-405b-a652-2e269e45f31f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.206830 Aug 24 17:51:45.885869 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 219/466] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:45 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:45.975862 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-607f6c06-da71-4932-8474-2077e6a74201 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:45.983494 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-607f6c06-da71-4932-8474-2077e6a74201 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1319 microversion: 2.1 time: 0.160343 Aug 24 17:51:45.984059 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 248/467] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:45 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:46.906443 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ebcb19b8-b6ff-4379-90dc-c98b8825ff84 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:46.907062 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ebcb19b8-b6ff-4379-90dc-c98b8825ff84 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:46.913393 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebcb19b8-b6ff-4379-90dc-c98b8825ff84 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:46.913879 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebcb19b8-b6ff-4379-90dc-c98b8825ff84 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:46.914317 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebcb19b8-b6ff-4379-90dc-c98b8825ff84 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:46.915010 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebcb19b8-b6ff-4379-90dc-c98b8825ff84 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:46.915465 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebcb19b8-b6ff-4379-90dc-c98b8825ff84 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:46.915978 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebcb19b8-b6ff-4379-90dc-c98b8825ff84 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:47.005029 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f34acbbc-1374-4148-a720-1fbfd6eacf8e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:47.005676 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f34acbbc-1374-4148-a720-1fbfd6eacf8e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:47.012430 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f34acbbc-1374-4148-a720-1fbfd6eacf8e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:47.013011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f34acbbc-1374-4148-a720-1fbfd6eacf8e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:47.013518 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f34acbbc-1374-4148-a720-1fbfd6eacf8e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:47.014280 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f34acbbc-1374-4148-a720-1fbfd6eacf8e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:47.014741 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f34acbbc-1374-4148-a720-1fbfd6eacf8e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:47.015164 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f34acbbc-1374-4148-a720-1fbfd6eacf8e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:47.053803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ebcb19b8-b6ff-4379-90dc-c98b8825ff84 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:47.062198 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ebcb19b8-b6ff-4379-90dc-c98b8825ff84 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1266 microversion: 2.1 time: 0.159637 Aug 24 17:51:47.062692 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 220/468] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:46 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:47.163897 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f34acbbc-1374-4148-a720-1fbfd6eacf8e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:47.171975 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f34acbbc-1374-4148-a720-1fbfd6eacf8e tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1319 microversion: 2.1 time: 0.171276 Aug 24 17:51:47.172544 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 249/469] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:46 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:48.085318 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-eb380b4c-92fb-4959-aa05-63fcdfe76f20 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:48.085851 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-eb380b4c-92fb-4959-aa05-63fcdfe76f20 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:48.092483 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eb380b4c-92fb-4959-aa05-63fcdfe76f20 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:48.092962 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eb380b4c-92fb-4959-aa05-63fcdfe76f20 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:48.093399 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eb380b4c-92fb-4959-aa05-63fcdfe76f20 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:48.094086 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eb380b4c-92fb-4959-aa05-63fcdfe76f20 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:48.094543 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eb380b4c-92fb-4959-aa05-63fcdfe76f20 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:48.094987 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eb380b4c-92fb-4959-aa05-63fcdfe76f20 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:48.193526 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4e1de7a2-40c4-4e8d-9117-32c7701c7390 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:48.194182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4e1de7a2-40c4-4e8d-9117-32c7701c7390 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:48.200632 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e1de7a2-40c4-4e8d-9117-32c7701c7390 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:48.201126 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e1de7a2-40c4-4e8d-9117-32c7701c7390 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:48.201567 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e1de7a2-40c4-4e8d-9117-32c7701c7390 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:48.202264 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e1de7a2-40c4-4e8d-9117-32c7701c7390 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:48.202730 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e1de7a2-40c4-4e8d-9117-32c7701c7390 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:48.203155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e1de7a2-40c4-4e8d-9117-32c7701c7390 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:48.226349 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-eb380b4c-92fb-4959-aa05-63fcdfe76f20 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:48.236704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-eb380b4c-92fb-4959-aa05-63fcdfe76f20 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1452 microversion: 2.1 time: 0.155483 Aug 24 17:51:48.237987 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 221/470] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:48 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:48.263302 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0bf5a0c4-034c-4ef8-bfb3-9861aacc2b59 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:48.263939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0bf5a0c4-034c-4ef8-bfb3-9861aacc2b59 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:48.270380 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0bf5a0c4-034c-4ef8-bfb3-9861aacc2b59 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:48.270866 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0bf5a0c4-034c-4ef8-bfb3-9861aacc2b59 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:48.271300 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0bf5a0c4-034c-4ef8-bfb3-9861aacc2b59 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:48.272010 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0bf5a0c4-034c-4ef8-bfb3-9861aacc2b59 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:48.272467 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0bf5a0c4-034c-4ef8-bfb3-9861aacc2b59 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:48.272885 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0bf5a0c4-034c-4ef8-bfb3-9861aacc2b59 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:48.340547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4e1de7a2-40c4-4e8d-9117-32c7701c7390 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:48.348157 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4e1de7a2-40c4-4e8d-9117-32c7701c7390 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1319 microversion: 2.1 time: 0.159011 Aug 24 17:51:48.348732 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 250/471] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:48 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:48.409692 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0bf5a0c4-034c-4ef8-bfb3-9861aacc2b59 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:48.417433 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0bf5a0c4-034c-4ef8-bfb3-9861aacc2b59 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1452 microversion: 2.1 time: 0.157890 Aug 24 17:51:48.418006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 222/472] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:48 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:51:48.875457 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-a49a2cc9-0cb5-43b2-8683-a37c43d6ef30 req-20f572e6-9d05-4c6c-b418-674ae163b48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a7d17d-7ecc-41be-82ac-5830631987db", "name": "network-vif-plugged", "status": "completed", "tag": "60dea019-bcb1-455e-b394-85dd4c545f26"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:48.889359 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-a49a2cc9-0cb5-43b2-8683-a37c43d6ef30 req-20f572e6-9d05-4c6c-b418-674ae163b48e service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:48.891272 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-a49a2cc9-0cb5-43b2-8683-a37c43d6ef30 req-20f572e6-9d05-4c6c-b418-674ae163b48e service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:48.891847 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-a49a2cc9-0cb5-43b2-8683-a37c43d6ef30 req-20f572e6-9d05-4c6c-b418-674ae163b48e service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:48.903324 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-a49a2cc9-0cb5-43b2-8683-a37c43d6ef30 req-20f572e6-9d05-4c6c-b418-674ae163b48e service nova] Creating event network-vif-plugged:60dea019-bcb1-455e-b394-85dd4c545f26 for instance 95a7d17d-7ecc-41be-82ac-5830631987db on hv-cinder-84052 Aug 24 17:51:48.909819 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-a49a2cc9-0cb5-43b2-8683-a37c43d6ef30 req-20f572e6-9d05-4c6c-b418-674ae163b48e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037946 Aug 24 17:51:48.910695 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 251/473] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:51:49.368455 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9903cc0b-d494-44f5-890d-0454c364f337 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:49.369104 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9903cc0b-d494-44f5-890d-0454c364f337 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:49.375611 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9903cc0b-d494-44f5-890d-0454c364f337 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:49.376263 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9903cc0b-d494-44f5-890d-0454c364f337 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:49.376691 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9903cc0b-d494-44f5-890d-0454c364f337 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:49.377377 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9903cc0b-d494-44f5-890d-0454c364f337 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:49.377850 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9903cc0b-d494-44f5-890d-0454c364f337 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:49.378267 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9903cc0b-d494-44f5-890d-0454c364f337 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:49.576367 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9903cc0b-d494-44f5-890d-0454c364f337 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:49.584638 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9903cc0b-d494-44f5-890d-0454c364f337 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1319 microversion: 2.1 time: 0.219975 Aug 24 17:51:49.585200 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 223/474] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:49 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:50.099239 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-585ab114-5024-4532-9f55-bdb43da21183 req-6d6073d5-eb3b-48b1-b6c4-dad87930bfcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b47b8e-315b-4035-b274-e3d90094cea0", "tag": "685b75ea-eb05-4e07-8542-1938a960343d"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:50.104027 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:50.104678 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=6 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:50.111732 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-585ab114-5024-4532-9f55-bdb43da21183 req-6d6073d5-eb3b-48b1-b6c4-dad87930bfcb service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:50.112255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-585ab114-5024-4532-9f55-bdb43da21183 req-6d6073d5-eb3b-48b1-b6c4-dad87930bfcb service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:50.112679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-585ab114-5024-4532-9f55-bdb43da21183 req-6d6073d5-eb3b-48b1-b6c4-dad87930bfcb service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:50.123282 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-585ab114-5024-4532-9f55-bdb43da21183 req-6d6073d5-eb3b-48b1-b6c4-dad87930bfcb service nova] Creating event network-changed:685b75ea-eb05-4e07-8542-1938a960343d for instance 33b47b8e-315b-4035-b274-e3d90094cea0 on hv-cinder-84052 Aug 24 17:51:50.128150 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-585ab114-5024-4532-9f55-bdb43da21183 req-6d6073d5-eb3b-48b1-b6c4-dad87930bfcb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033496 Aug 24 17:51:50.128729 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 252/475] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:51:50.606172 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-bb3d1ee1-153a-4843-8a34-7d6797871dcb tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:50.606890 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-bb3d1ee1-153a-4843-8a34-7d6797871dcb tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:50.608952 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:50.615539 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bb3d1ee1-153a-4843-8a34-7d6797871dcb tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:50.616092 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bb3d1ee1-153a-4843-8a34-7d6797871dcb tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:50.616461 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bb3d1ee1-153a-4843-8a34-7d6797871dcb tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:50.617150 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bb3d1ee1-153a-4843-8a34-7d6797871dcb tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:50.617615 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bb3d1ee1-153a-4843-8a34-7d6797871dcb tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:50.618021 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bb3d1ee1-153a-4843-8a34-7d6797871dcb tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:50.622072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=100 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:51:50.746015 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-bb3d1ee1-153a-4843-8a34-7d6797871dcb tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:50.753665 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-bb3d1ee1-153a-4843-8a34-7d6797871dcb tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1319 microversion: 2.1 time: 0.151405 Aug 24 17:51:50.754225 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 224/476] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:50 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:51.774552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-65b4a51d-59b6-4075-b6ec-b0b4d6ffc9e5 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:51:51.775169 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-65b4a51d-59b6-4075-b6ec-b0b4d6ffc9e5 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:51.781252 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-65b4a51d-59b6-4075-b6ec-b0b4d6ffc9e5 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:51.781725 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-65b4a51d-59b6-4075-b6ec-b0b4d6ffc9e5 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:51.782157 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-65b4a51d-59b6-4075-b6ec-b0b4d6ffc9e5 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:51.782833 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-65b4a51d-59b6-4075-b6ec-b0b4d6ffc9e5 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:51.783281 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-65b4a51d-59b6-4075-b6ec-b0b4d6ffc9e5 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:51.784310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-65b4a51d-59b6-4075-b6ec-b0b4d6ffc9e5 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:51.915221 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-65b4a51d-59b6-4075-b6ec-b0b4d6ffc9e5 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:51:51.922865 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-65b4a51d-59b6-4075-b6ec-b0b4d6ffc9e5 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1507 microversion: 2.1 time: 0.153076 Aug 24 17:51:51.923419 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 253/477] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:51:51 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:51:51.943351 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ed642510-dd8e-4bb4-80ed-b20b3d39dc82 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37f80cab-16ef-4453-97d5-fc7c43b5fee4", "device": "/dev/sdb"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:51:51.946297 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ed642510-dd8e-4bb4-80ed-b20b3d39dc82 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:51:51.952652 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ed642510-dd8e-4bb4-80ed-b20b3d39dc82 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:51.953133 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ed642510-dd8e-4bb4-80ed-b20b3d39dc82 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:51.953568 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ed642510-dd8e-4bb4-80ed-b20b3d39dc82 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:51.954260 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ed642510-dd8e-4bb4-80ed-b20b3d39dc82 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:51:51.954714 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ed642510-dd8e-4bb4-80ed-b20b3d39dc82 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:51:51.955136 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ed642510-dd8e-4bb4-80ed-b20b3d39dc82 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:51:52.187803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ed642510-dd8e-4bb4-80ed-b20b3d39dc82 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "POST /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248809 Aug 24 17:51:52.188406 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 225/478] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:51:51 2022] POST /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:00.256705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3132459f-fea1-424d-82da-a06940dacd07 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cc9ba26-34c2-4837-ab76-541b73d07c25"}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:00.258989 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3132459f-fea1-424d-82da-a06940dacd07 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:00.265563 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3132459f-fea1-424d-82da-a06940dacd07 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:00.266041 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3132459f-fea1-424d-82da-a06940dacd07 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:00.266470 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3132459f-fea1-424d-82da-a06940dacd07 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:00.267151 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3132459f-fea1-424d-82da-a06940dacd07 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:00.267633 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3132459f-fea1-424d-82da-a06940dacd07 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:00.268052 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3132459f-fea1-424d-82da-a06940dacd07 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:03.222793 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3132459f-fea1-424d-82da-a06940dacd07 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "POST /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.969945 Aug 24 17:52:03.223462 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 254/479] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:52:00 2022] POST /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments => generated 194 bytes in 2971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:52:10.745420 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a6e7afaa-d87e-46f6-a39a-29695698c634 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:10.747816 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a6e7afaa-d87e-46f6-a39a-29695698c634 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:10.750437 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=35 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:10.751103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:10.757485 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a6e7afaa-d87e-46f6-a39a-29695698c634 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:10.758023 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a6e7afaa-d87e-46f6-a39a-29695698c634 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:10.758456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a6e7afaa-d87e-46f6-a39a-29695698c634 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:10.759142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a6e7afaa-d87e-46f6-a39a-29695698c634 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:10.759622 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a6e7afaa-d87e-46f6-a39a-29695698c634 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:10.760045 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a6e7afaa-d87e-46f6-a39a-29695698c634 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:10.783336 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-a6e7afaa-d87e-46f6-a39a-29695698c634 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lazy-loading 'flavor' on Instance uuid ef24bd4c-630a-428f-9eb7-50c5009e9fe1 {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:52:10.902832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a6e7afaa-d87e-46f6-a39a-29695698c634 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "POST /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/action" status: 200 len: 32 microversion: 2.1 time: 0.161640 Aug 24 17:52:10.903536 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 226/480] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:52:10 2022] POST /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:52:10.910772 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:10.915398 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a66496d5-6507-41e0-b751-131f5833a8a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:10.916273 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a66496d5-6507-41e0-b751-131f5833a8a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:10.923294 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a66496d5-6507-41e0-b751-131f5833a8a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:10.923866 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a66496d5-6507-41e0-b751-131f5833a8a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:10.924363 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a66496d5-6507-41e0-b751-131f5833a8a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:10.925059 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a66496d5-6507-41e0-b751-131f5833a8a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:10.925553 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a66496d5-6507-41e0-b751-131f5833a8a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:10.925981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a66496d5-6507-41e0-b751-131f5833a8a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:11.141303 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a66496d5-6507-41e0-b751-131f5833a8a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:11.149474 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a66496d5-6507-41e0-b751-131f5833a8a8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.240228 Aug 24 17:52:11.150043 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 255/481] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:10 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:11.520784 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-86b73919-57b4-4a3b-bc75-0da023e03bf7 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:11.521372 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-86b73919-57b4-4a3b-bc75-0da023e03bf7 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:11.527567 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86b73919-57b4-4a3b-bc75-0da023e03bf7 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:11.528060 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86b73919-57b4-4a3b-bc75-0da023e03bf7 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:11.528497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86b73919-57b4-4a3b-bc75-0da023e03bf7 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:11.529200 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86b73919-57b4-4a3b-bc75-0da023e03bf7 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:11.529658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86b73919-57b4-4a3b-bc75-0da023e03bf7 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:11.530074 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-86b73919-57b4-4a3b-bc75-0da023e03bf7 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:11.656440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-86b73919-57b4-4a3b-bc75-0da023e03bf7 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lazy-loading 'services' on Instance uuid 95a7d17d-7ecc-41be-82ac-5830631987db {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:52:11.767333 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-86b73919-57b4-4a3b-bc75-0da023e03bf7 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "DELETE /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db/os-volume_attachments/37f80cab-16ef-4453-97d5-fc7c43b5fee4" status: 202 len: 0 microversion: 2.1 time: 0.251186 Aug 24 17:52:11.768630 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 227/482] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 17:52:11 2022] DELETE /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db/os-volume_attachments/37f80cab-16ef-4453-97d5-fc7c43b5fee4 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:52:12.170242 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-17807070-426c-4dac-b371-4cbc9f4bcff0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:12.170888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-17807070-426c-4dac-b371-4cbc9f4bcff0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:12.177298 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17807070-426c-4dac-b371-4cbc9f4bcff0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:12.177787 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17807070-426c-4dac-b371-4cbc9f4bcff0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:12.178227 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17807070-426c-4dac-b371-4cbc9f4bcff0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:12.178921 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17807070-426c-4dac-b371-4cbc9f4bcff0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:12.179378 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17807070-426c-4dac-b371-4cbc9f4bcff0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:12.179835 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-17807070-426c-4dac-b371-4cbc9f4bcff0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:12.310118 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-17807070-426c-4dac-b371-4cbc9f4bcff0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:12.318775 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-17807070-426c-4dac-b371-4cbc9f4bcff0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.152496 Aug 24 17:52:12.319336 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 256/483] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:12 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:12.884864 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-682d049d-a2c0-4ffb-ba89-c2edf38f9b34 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:12.885451 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-682d049d-a2c0-4ffb-ba89-c2edf38f9b34 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:12.892605 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-682d049d-a2c0-4ffb-ba89-c2edf38f9b34 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:12.893093 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-682d049d-a2c0-4ffb-ba89-c2edf38f9b34 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:12.893527 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-682d049d-a2c0-4ffb-ba89-c2edf38f9b34 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:12.894216 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-682d049d-a2c0-4ffb-ba89-c2edf38f9b34 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:12.894667 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-682d049d-a2c0-4ffb-ba89-c2edf38f9b34 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:12.895125 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-682d049d-a2c0-4ffb-ba89-c2edf38f9b34 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:12.919451 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-682d049d-a2c0-4ffb-ba89-c2edf38f9b34 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:52:12.993361 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-682d049d-a2c0-4ffb-ba89-c2edf38f9b34 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "DELETE /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 204 len: 0 microversion: 2.1 time: 0.112358 Aug 24 17:52:12.993850 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 228/484] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:52:12 2022] DELETE /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:52:13.002303 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-37709426-c885-4139-9b41-43b007c86c44 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:13.002920 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-37709426-c885-4139-9b41-43b007c86c44 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:13.009287 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-37709426-c885-4139-9b41-43b007c86c44 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:13.009771 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-37709426-c885-4139-9b41-43b007c86c44 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:13.010211 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-37709426-c885-4139-9b41-43b007c86c44 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:13.010900 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-37709426-c885-4139-9b41-43b007c86c44 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:13.011358 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-37709426-c885-4139-9b41-43b007c86c44 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:13.011817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-37709426-c885-4139-9b41-43b007c86c44 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:13.142499 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-37709426-c885-4139-9b41-43b007c86c44 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:13.150327 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-37709426-c885-4139-9b41-43b007c86c44 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1513 microversion: 2.1 time: 0.151893 Aug 24 17:52:13.150887 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 257/485] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:12 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:13.341255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d3a2a488-0693-4b84-bee4-eac26df45a0b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:13.341904 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d3a2a488-0693-4b84-bee4-eac26df45a0b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:13.348398 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d3a2a488-0693-4b84-bee4-eac26df45a0b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:13.348877 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d3a2a488-0693-4b84-bee4-eac26df45a0b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:13.349311 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d3a2a488-0693-4b84-bee4-eac26df45a0b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:13.349994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d3a2a488-0693-4b84-bee4-eac26df45a0b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:13.350444 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d3a2a488-0693-4b84-bee4-eac26df45a0b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:13.350863 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d3a2a488-0693-4b84-bee4-eac26df45a0b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:13.481919 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d3a2a488-0693-4b84-bee4-eac26df45a0b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:13.490043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d3a2a488-0693-4b84-bee4-eac26df45a0b tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.153120 Aug 24 17:52:13.490603 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 229/486] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:13 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:14.172810 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8a67fc82-d181-4394-8012-b6247c83f33d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:14.173370 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8a67fc82-d181-4394-8012-b6247c83f33d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:14.179724 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8a67fc82-d181-4394-8012-b6247c83f33d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:14.180201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8a67fc82-d181-4394-8012-b6247c83f33d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:14.180631 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8a67fc82-d181-4394-8012-b6247c83f33d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:14.181306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8a67fc82-d181-4394-8012-b6247c83f33d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:14.181754 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8a67fc82-d181-4394-8012-b6247c83f33d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:14.182172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8a67fc82-d181-4394-8012-b6247c83f33d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:14.310683 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8a67fc82-d181-4394-8012-b6247c83f33d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:14.318893 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8a67fc82-d181-4394-8012-b6247c83f33d tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1513 microversion: 2.1 time: 0.149989 Aug 24 17:52:14.319471 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 258/487] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:14 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:14.511034 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9c8f9659-ce2c-4603-b752-8fa2ff8208f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:14.511739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9c8f9659-ce2c-4603-b752-8fa2ff8208f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:14.518112 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9c8f9659-ce2c-4603-b752-8fa2ff8208f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:14.518591 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9c8f9659-ce2c-4603-b752-8fa2ff8208f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:14.519025 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9c8f9659-ce2c-4603-b752-8fa2ff8208f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:14.519745 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9c8f9659-ce2c-4603-b752-8fa2ff8208f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:14.520196 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9c8f9659-ce2c-4603-b752-8fa2ff8208f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:14.520617 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9c8f9659-ce2c-4603-b752-8fa2ff8208f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:14.653139 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9c8f9659-ce2c-4603-b752-8fa2ff8208f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:14.661817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9c8f9659-ce2c-4603-b752-8fa2ff8208f8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.154599 Aug 24 17:52:14.662381 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 230/488] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:14 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:15.339866 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-dfc1b993-70af-476a-b784-bcfecafc52d4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:15.340414 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-dfc1b993-70af-476a-b784-bcfecafc52d4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:15.346773 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dfc1b993-70af-476a-b784-bcfecafc52d4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:15.347256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dfc1b993-70af-476a-b784-bcfecafc52d4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:15.347739 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dfc1b993-70af-476a-b784-bcfecafc52d4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:15.348438 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dfc1b993-70af-476a-b784-bcfecafc52d4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:15.348894 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dfc1b993-70af-476a-b784-bcfecafc52d4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:15.349317 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dfc1b993-70af-476a-b784-bcfecafc52d4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:15.353216 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:15.540113 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-dfc1b993-70af-476a-b784-bcfecafc52d4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:15.548003 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-dfc1b993-70af-476a-b784-bcfecafc52d4 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1513 microversion: 2.1 time: 0.212381 Aug 24 17:52:15.549096 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 259/489] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:15 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:15.682998 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7222745b-7db7-4587-b035-f02f9e13db27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:15.683703 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7222745b-7db7-4587-b035-f02f9e13db27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:15.690660 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7222745b-7db7-4587-b035-f02f9e13db27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:15.691232 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7222745b-7db7-4587-b035-f02f9e13db27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:15.691761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7222745b-7db7-4587-b035-f02f9e13db27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:15.692523 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7222745b-7db7-4587-b035-f02f9e13db27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:15.693046 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7222745b-7db7-4587-b035-f02f9e13db27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:15.693590 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7222745b-7db7-4587-b035-f02f9e13db27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:15.829721 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7222745b-7db7-4587-b035-f02f9e13db27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:15.839241 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7222745b-7db7-4587-b035-f02f9e13db27 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.159991 Aug 24 17:52:15.852540 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 231/490] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:15 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:16.142625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-315f4dc0-60c0-4c23-8b18-31fc731ca690 req-e7970ce1-28f7-4666-a95a-ffe157db0f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a7d17d-7ecc-41be-82ac-5830631987db", "name": "network-vif-deleted", "tag": "60dea019-bcb1-455e-b394-85dd4c545f26"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:16.154149 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-315f4dc0-60c0-4c23-8b18-31fc731ca690 req-e7970ce1-28f7-4666-a95a-ffe157db0f96 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:16.154795 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-315f4dc0-60c0-4c23-8b18-31fc731ca690 req-e7970ce1-28f7-4666-a95a-ffe157db0f96 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:16.155231 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-315f4dc0-60c0-4c23-8b18-31fc731ca690 req-e7970ce1-28f7-4666-a95a-ffe157db0f96 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:16.169647 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-315f4dc0-60c0-4c23-8b18-31fc731ca690 req-e7970ce1-28f7-4666-a95a-ffe157db0f96 service nova] Creating event network-vif-deleted:60dea019-bcb1-455e-b394-85dd4c545f26 for instance 95a7d17d-7ecc-41be-82ac-5830631987db on hv-cinder-84052 Aug 24 17:52:16.175371 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-315f4dc0-60c0-4c23-8b18-31fc731ca690 req-e7970ce1-28f7-4666-a95a-ffe157db0f96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036581 Aug 24 17:52:16.175995 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 260/491] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:16.569211 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:16.569852 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:16.575667 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:16.576149 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:16.576578 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:16.577258 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:16.577705 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:16.578119 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:16.610390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:16.610869 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:16.611294 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:16.611760 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lazy-loading 'fault' on Instance uuid 95a7d17d-7ecc-41be-82ac-5830631987db {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:52:16.662807 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21fdd2fd30544e4e9e0bf184034106fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b756a7bd444bf3aec562b2717f5623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:16.671398 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c91fb520-9f34-4be8-96d9-698be2566303 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 200 len: 1309 microversion: 2.1 time: 0.105959 Aug 24 17:52:16.672024 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 232/492] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:16 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:16.862433 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-bf29cfe9-97c9-44fe-8208-aafaf3757f86 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:16.863065 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-bf29cfe9-97c9-44fe-8208-aafaf3757f86 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:16.869103 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bf29cfe9-97c9-44fe-8208-aafaf3757f86 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:16.869584 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bf29cfe9-97c9-44fe-8208-aafaf3757f86 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:16.870019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bf29cfe9-97c9-44fe-8208-aafaf3757f86 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:16.870701 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bf29cfe9-97c9-44fe-8208-aafaf3757f86 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:16.871153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bf29cfe9-97c9-44fe-8208-aafaf3757f86 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:16.871602 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bf29cfe9-97c9-44fe-8208-aafaf3757f86 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:17.003139 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bf29cfe9-97c9-44fe-8208-aafaf3757f86 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:17.011273 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-bf29cfe9-97c9-44fe-8208-aafaf3757f86 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.153764 Aug 24 17:52:17.011870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 261/493] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:16 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:17.692628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b46645ca-de5f-42c8-b7a1-6ba8ac7c9e95 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:17.693233 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b46645ca-de5f-42c8-b7a1-6ba8ac7c9e95 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] [instance: 95a7d17d-7ecc-41be-82ac-5830631987db] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:17.699621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b46645ca-de5f-42c8-b7a1-6ba8ac7c9e95 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:17.700100 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b46645ca-de5f-42c8-b7a1-6ba8ac7c9e95 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:17.700531 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b46645ca-de5f-42c8-b7a1-6ba8ac7c9e95 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:17.701212 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b46645ca-de5f-42c8-b7a1-6ba8ac7c9e95 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:17.701662 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b46645ca-de5f-42c8-b7a1-6ba8ac7c9e95 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:17.702079 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b46645ca-de5f-42c8-b7a1-6ba8ac7c9e95 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:17.716285 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-b46645ca-de5f-42c8-b7a1-6ba8ac7c9e95 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] HTTP exception thrown: Instance 95a7d17d-7ecc-41be-82ac-5830631987db could not be found. Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b46645ca-de5f-42c8-b7a1-6ba8ac7c9e95 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Request method failure captured: Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db HTTP/1.1 Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmTHKTEIHCa3XiDtiiIYp2pfi1okZaFlaJ_emVxblupyGvjXCrrkmsnx6vseurxFPqje1RzDK5abe2fOhmA7MsOET9SA7BC1DT92f833TiHbnIxWVM5JCn9A38LVIMzg6_niDNq19Bh8zjp9KVrl88j_grpBPj08kmc-N5IDzq6c4P0 Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: b3b756a7bd444bf3aec562b2717f5623 Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-VolumesSnapshotTestJSON-439425440 Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:52:17.717875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:52:17.719390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b3b756a7bd444bf3aec562b2717f5623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3b756a7bd444bf3aec562b2717f5623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b3b756a7bd444bf3aec562b2717f5623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b3b756a7bd444bf3aec562b2717f5623"}]}] Aug 24 17:52:17.719390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-VolumesSnapshotTestJSON-439425440 Aug 24 17:52:17.719390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: b3b756a7bd444bf3aec562b2717f5623 Aug 24 17:52:17.719390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-439425440 Aug 24 17:52:17.719390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-VolumesSnapshotTestJSON-439425440-project Aug 24 17:52:17.719390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:52:17.719390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:52:17.719390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 21fdd2fd30544e4e9e0bf184034106fa Aug 24 17:52:17.719390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-VolumesSnapshotTestJSON-439425440-project Aug 24 17:52:17.719390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:52:17.719390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 95a7d17d-7ecc-41be-82ac-5830631987db could not be found. Aug 24 17:52:17.719390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '95a7d17d-7ecc-41be-82ac-5830631987db'} Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a7d17d-7ecc-41be-82ac-5830631987db could not be found. Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:52:17.720278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a7d17d-7ecc-41be-82ac-5830631987db could not be found. Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a7d17d-7ecc-41be-82ac-5830631987db could not be found. Aug 24 17:52:17.721761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:52:17.723171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b46645ca-de5f-42c8-b7a1-6ba8ac7c9e95 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] Returning 404 to user: Instance 95a7d17d-7ecc-41be-82ac-5830631987db could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:52:17.723171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b46645ca-de5f-42c8-b7a1-6ba8ac7c9e95 tempest-VolumesSnapshotTestJSON-439425440 tempest-VolumesSnapshotTestJSON-439425440-project] 10.222.0.27 "GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db" status: 404 len: 111 microversion: 2.1 time: 0.030989 Aug 24 17:52:17.723171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 233/494] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:17 2022] GET /compute/v2.1/servers/95a7d17d-7ecc-41be-82ac-5830631987db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:52:18.032529 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0924bb0c-b14e-4419-ab92-3f1abadff14f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:18.033188 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0924bb0c-b14e-4419-ab92-3f1abadff14f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:18.039598 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0924bb0c-b14e-4419-ab92-3f1abadff14f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:18.040176 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0924bb0c-b14e-4419-ab92-3f1abadff14f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:18.040618 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0924bb0c-b14e-4419-ab92-3f1abadff14f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:18.041314 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0924bb0c-b14e-4419-ab92-3f1abadff14f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:18.041858 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0924bb0c-b14e-4419-ab92-3f1abadff14f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:18.042300 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0924bb0c-b14e-4419-ab92-3f1abadff14f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:18.174477 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0924bb0c-b14e-4419-ab92-3f1abadff14f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:18.182687 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0924bb0c-b14e-4419-ab92-3f1abadff14f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.154210 Aug 24 17:52:18.183251 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 262/495] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:18 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:52:19.202839 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5b6ee826-84a5-49a3-859a-66bea3075e6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:19.203561 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5b6ee826-84a5-49a3-859a-66bea3075e6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:19.209977 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b6ee826-84a5-49a3-859a-66bea3075e6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:19.210463 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b6ee826-84a5-49a3-859a-66bea3075e6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:19.211154 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b6ee826-84a5-49a3-859a-66bea3075e6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:19.211879 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b6ee826-84a5-49a3-859a-66bea3075e6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:19.212331 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b6ee826-84a5-49a3-859a-66bea3075e6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:19.212750 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b6ee826-84a5-49a3-859a-66bea3075e6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:19.341678 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-5b6ee826-84a5-49a3-859a-66bea3075e6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:19.350382 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5b6ee826-84a5-49a3-859a-66bea3075e6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.151273 Aug 24 17:52:19.351264 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 234/496] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:19 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:20.371851 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-07efb6b3-215e-4f31-90ee-f5744179e8b8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:20.372471 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-07efb6b3-215e-4f31-90ee-f5744179e8b8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:20.379494 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-07efb6b3-215e-4f31-90ee-f5744179e8b8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:20.380016 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-07efb6b3-215e-4f31-90ee-f5744179e8b8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:20.380459 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-07efb6b3-215e-4f31-90ee-f5744179e8b8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:20.381148 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-07efb6b3-215e-4f31-90ee-f5744179e8b8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:20.381614 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-07efb6b3-215e-4f31-90ee-f5744179e8b8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:20.382041 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-07efb6b3-215e-4f31-90ee-f5744179e8b8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:20.507139 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-07efb6b3-215e-4f31-90ee-f5744179e8b8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:20.515319 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-07efb6b3-215e-4f31-90ee-f5744179e8b8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.147357 Aug 24 17:52:20.515988 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 263/497] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:20 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:21.536394 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-fe61bdcf-dca7-4204-9b32-fc657fa13d8f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:21.537035 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-fe61bdcf-dca7-4204-9b32-fc657fa13d8f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:21.543544 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fe61bdcf-dca7-4204-9b32-fc657fa13d8f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:21.544026 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fe61bdcf-dca7-4204-9b32-fc657fa13d8f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:21.544458 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fe61bdcf-dca7-4204-9b32-fc657fa13d8f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:21.545145 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fe61bdcf-dca7-4204-9b32-fc657fa13d8f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:21.545598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fe61bdcf-dca7-4204-9b32-fc657fa13d8f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:21.546024 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fe61bdcf-dca7-4204-9b32-fc657fa13d8f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:21.673119 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-fe61bdcf-dca7-4204-9b32-fc657fa13d8f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:21.681792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-fe61bdcf-dca7-4204-9b32-fc657fa13d8f tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.149301 Aug 24 17:52:21.682360 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 235/498] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:21 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:22.703735 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d4b1e9b6-0f1e-4fb9-a82f-0e72d51de2aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:22.704355 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d4b1e9b6-0f1e-4fb9-a82f-0e72d51de2aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:22.711152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d4b1e9b6-0f1e-4fb9-a82f-0e72d51de2aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:22.711681 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d4b1e9b6-0f1e-4fb9-a82f-0e72d51de2aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:22.712127 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d4b1e9b6-0f1e-4fb9-a82f-0e72d51de2aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:22.712821 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d4b1e9b6-0f1e-4fb9-a82f-0e72d51de2aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:22.713281 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d4b1e9b6-0f1e-4fb9-a82f-0e72d51de2aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:22.713727 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d4b1e9b6-0f1e-4fb9-a82f-0e72d51de2aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:22.842043 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d4b1e9b6-0f1e-4fb9-a82f-0e72d51de2aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:22.850765 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d4b1e9b6-0f1e-4fb9-a82f-0e72d51de2aa tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.150960 Aug 24 17:52:22.851329 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 264/499] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:22 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:23.871596 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-dc986c05-b6c5-4626-a445-e48f444ce5ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:23.872210 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-dc986c05-b6c5-4626-a445-e48f444ce5ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:23.878743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc986c05-b6c5-4626-a445-e48f444ce5ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:23.879227 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc986c05-b6c5-4626-a445-e48f444ce5ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:23.879700 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc986c05-b6c5-4626-a445-e48f444ce5ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:23.880394 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc986c05-b6c5-4626-a445-e48f444ce5ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:23.880851 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc986c05-b6c5-4626-a445-e48f444ce5ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:23.881274 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc986c05-b6c5-4626-a445-e48f444ce5ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:24.010650 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-dc986c05-b6c5-4626-a445-e48f444ce5ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:24.018804 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-dc986c05-b6c5-4626-a445-e48f444ce5ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.151102 Aug 24 17:52:24.019899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 236/500] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:23 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:25.041184 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-55bcf9a2-f01a-4140-b5f7-2b1ab5b215b0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:25.041894 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-55bcf9a2-f01a-4140-b5f7-2b1ab5b215b0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:25.048526 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-55bcf9a2-f01a-4140-b5f7-2b1ab5b215b0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:25.049051 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-55bcf9a2-f01a-4140-b5f7-2b1ab5b215b0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:25.049486 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-55bcf9a2-f01a-4140-b5f7-2b1ab5b215b0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:25.050174 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-55bcf9a2-f01a-4140-b5f7-2b1ab5b215b0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:25.051293 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-55bcf9a2-f01a-4140-b5f7-2b1ab5b215b0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:25.051774 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-55bcf9a2-f01a-4140-b5f7-2b1ab5b215b0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:25.182294 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-55bcf9a2-f01a-4140-b5f7-2b1ab5b215b0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:25.190671 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-55bcf9a2-f01a-4140-b5f7-2b1ab5b215b0 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.153786 Aug 24 17:52:25.191234 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 265/501] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:25 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:26.212959 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-fb6cec0d-f7c6-4040-b41d-59f0785b8d04 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:26.213566 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-fb6cec0d-f7c6-4040-b41d-59f0785b8d04 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:26.219935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fb6cec0d-f7c6-4040-b41d-59f0785b8d04 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:26.220411 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fb6cec0d-f7c6-4040-b41d-59f0785b8d04 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:26.220835 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fb6cec0d-f7c6-4040-b41d-59f0785b8d04 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:26.221515 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fb6cec0d-f7c6-4040-b41d-59f0785b8d04 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:26.221961 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fb6cec0d-f7c6-4040-b41d-59f0785b8d04 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:26.223017 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fb6cec0d-f7c6-4040-b41d-59f0785b8d04 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:26.350027 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-fb6cec0d-f7c6-4040-b41d-59f0785b8d04 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:26.358113 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-fb6cec0d-f7c6-4040-b41d-59f0785b8d04 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.149317 Aug 24 17:52:26.358675 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 237/502] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:26 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:27.379249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c54dc18b-e08a-475d-a5d9-cbca17cd855c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:27.379838 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c54dc18b-e08a-475d-a5d9-cbca17cd855c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:27.386201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c54dc18b-e08a-475d-a5d9-cbca17cd855c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:27.386683 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c54dc18b-e08a-475d-a5d9-cbca17cd855c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:27.387126 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c54dc18b-e08a-475d-a5d9-cbca17cd855c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:27.387845 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c54dc18b-e08a-475d-a5d9-cbca17cd855c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:27.388307 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c54dc18b-e08a-475d-a5d9-cbca17cd855c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:27.388732 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c54dc18b-e08a-475d-a5d9-cbca17cd855c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:27.518930 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c54dc18b-e08a-475d-a5d9-cbca17cd855c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:27.527304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c54dc18b-e08a-475d-a5d9-cbca17cd855c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.152485 Aug 24 17:52:27.527899 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 266/503] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:27 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:28.548520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8654b73c-27f8-4e51-a22c-92f3bbe3da24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:28.549140 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8654b73c-27f8-4e51-a22c-92f3bbe3da24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:28.555961 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8654b73c-27f8-4e51-a22c-92f3bbe3da24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:28.556449 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8654b73c-27f8-4e51-a22c-92f3bbe3da24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:28.556884 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8654b73c-27f8-4e51-a22c-92f3bbe3da24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:28.557574 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8654b73c-27f8-4e51-a22c-92f3bbe3da24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:28.558030 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8654b73c-27f8-4e51-a22c-92f3bbe3da24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:28.558454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8654b73c-27f8-4e51-a22c-92f3bbe3da24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:28.576826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:28.695635 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8654b73c-27f8-4e51-a22c-92f3bbe3da24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:28.703926 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8654b73c-27f8-4e51-a22c-92f3bbe3da24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.159269 Aug 24 17:52:28.704493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 238/504] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:28 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:29.725979 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7b70d3e5-d81e-46cf-822c-d2ee22ef018e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:29.726590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7b70d3e5-d81e-46cf-822c-d2ee22ef018e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:29.733009 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b70d3e5-d81e-46cf-822c-d2ee22ef018e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:29.733499 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b70d3e5-d81e-46cf-822c-d2ee22ef018e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:29.733940 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b70d3e5-d81e-46cf-822c-d2ee22ef018e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:29.734636 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b70d3e5-d81e-46cf-822c-d2ee22ef018e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:29.735096 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b70d3e5-d81e-46cf-822c-d2ee22ef018e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:29.735554 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7b70d3e5-d81e-46cf-822c-d2ee22ef018e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:29.868296 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7b70d3e5-d81e-46cf-822c-d2ee22ef018e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:29.876454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7b70d3e5-d81e-46cf-822c-d2ee22ef018e tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.154935 Aug 24 17:52:29.877005 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 267/505] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:29 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:30.898692 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2a24cf6e-27df-4c54-9837-9ed4af8d24f9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:30.899346 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2a24cf6e-27df-4c54-9837-9ed4af8d24f9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:30.906655 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a24cf6e-27df-4c54-9837-9ed4af8d24f9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:30.907157 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a24cf6e-27df-4c54-9837-9ed4af8d24f9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:30.907616 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a24cf6e-27df-4c54-9837-9ed4af8d24f9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:30.908323 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a24cf6e-27df-4c54-9837-9ed4af8d24f9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:30.908771 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a24cf6e-27df-4c54-9837-9ed4af8d24f9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:30.909290 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a24cf6e-27df-4c54-9837-9ed4af8d24f9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:31.041697 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2a24cf6e-27df-4c54-9837-9ed4af8d24f9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:31.049821 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2a24cf6e-27df-4c54-9837-9ed4af8d24f9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.156308 Aug 24 17:52:31.050432 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 239/506] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:30 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:32.071999 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f0b92382-05a9-4520-94aa-f4d75488a491 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:32.072617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f0b92382-05a9-4520-94aa-f4d75488a491 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:32.078986 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f0b92382-05a9-4520-94aa-f4d75488a491 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:32.079498 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f0b92382-05a9-4520-94aa-f4d75488a491 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:32.079952 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f0b92382-05a9-4520-94aa-f4d75488a491 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:32.080647 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f0b92382-05a9-4520-94aa-f4d75488a491 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:32.081114 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f0b92382-05a9-4520-94aa-f4d75488a491 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:32.082071 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f0b92382-05a9-4520-94aa-f4d75488a491 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:32.215113 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f0b92382-05a9-4520-94aa-f4d75488a491 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:32.224093 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f0b92382-05a9-4520-94aa-f4d75488a491 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1735 microversion: 2.1 time: 0.156052 Aug 24 17:52:32.224657 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 268/507] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:32 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:33.245222 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3765716f-fc31-49c2-b97e-5ca5395900f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:33.245823 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3765716f-fc31-49c2-b97e-5ca5395900f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:33.253074 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3765716f-fc31-49c2-b97e-5ca5395900f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.253578 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3765716f-fc31-49c2-b97e-5ca5395900f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.254019 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3765716f-fc31-49c2-b97e-5ca5395900f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.254747 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3765716f-fc31-49c2-b97e-5ca5395900f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.255242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3765716f-fc31-49c2-b97e-5ca5395900f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.255707 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3765716f-fc31-49c2-b97e-5ca5395900f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.388169 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-3765716f-fc31-49c2-b97e-5ca5395900f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:33.396331 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-3765716f-fc31-49c2-b97e-5ca5395900f4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1715 microversion: 2.1 time: 0.155063 Aug 24 17:52:33.396886 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 240/508] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:33 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:33.503228 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-71852c9e-6270-443e-9676-b0fdcd565f24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:33.503770 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-71852c9e-6270-443e-9676-b0fdcd565f24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:33.510320 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-71852c9e-6270-443e-9676-b0fdcd565f24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.510802 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-71852c9e-6270-443e-9676-b0fdcd565f24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.511237 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-71852c9e-6270-443e-9676-b0fdcd565f24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.511953 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-71852c9e-6270-443e-9676-b0fdcd565f24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.512408 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-71852c9e-6270-443e-9676-b0fdcd565f24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.512829 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-71852c9e-6270-443e-9676-b0fdcd565f24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.591720 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-71852c9e-6270-443e-9676-b0fdcd565f24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] HTTP exception thrown: Cannot 'detach_volume' instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 while it is in vm_state rescued Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-71852c9e-6270-443e-9676-b0fdcd565f24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Request method failure captured: Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: DELETE /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments/2cc9ba26-34c2-4837-ab76-541b73d07c25 HTTP/1.1 Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmRXXSo9jllcBh3muzG85q1balMF-atjt1OIcAyxcjw16hc-GKcl2STFaNuxKTBDjXoLg9uWGhPWb1tYXoxnNn1OLjyOjPO8b_l3i-5sX-s3w4NWOcztytI1Id99vRg8qfxhsCxnCb1ylUJJIWsQ8B0GF2Xv2njFbtGFkpHPXQPeznc Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 0fb78a439e20439f8d93a4f7df3f28f8 Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:52:33.593454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:52:33.595055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fb78a439e20439f8d93a4f7df3f28f8"}]}] Aug 24 17:52:33.595055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:52:33.595055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 0fb78a439e20439f8d93a4f7df3f28f8 Aug 24 17:52:33.595055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:52:33.595055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-ServerRescueNegativeTestJSON-1642173346-project Aug 24 17:52:33.595055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:52:33.595055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:52:33.595055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 7d3139d9e58f4b56a370661e2a5d4e5e Aug 24 17:52:33.595055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1642173346-project Aug 24 17:52:33.595055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:52:33.595055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Cannot 'detach_volume' instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 while it is in vm_state rescued Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'server_id': 'ef24bd4c-630a-428f-9eb7-50c5009e9fe1', 'id': '2cc9ba26-34c2-4837-ab76-541b73d07c25'} Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:52:33.595856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 while it is in vm_state rescued Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 while it is in vm_state rescued Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:52:33.597668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-71852c9e-6270-443e-9676-b0fdcd565f24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Returning 409 to user: Cannot 'detach_volume' instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 while it is in vm_state rescued {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:52:33.598651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-71852c9e-6270-443e-9676-b0fdcd565f24 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments/2cc9ba26-34c2-4837-ab76-541b73d07c25" status: 409 len: 152 microversion: 2.1 time: 0.095680 Aug 24 17:52:33.598651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 269/509] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 17:52:33 2022] DELETE /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments/2cc9ba26-34c2-4837-ab76-541b73d07c25 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 17:52:33.604200 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-fbea15d1-2083-469a-883c-b4824a93ff63 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:33.604724 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-fbea15d1-2083-469a-883c-b4824a93ff63 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:33.610545 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fbea15d1-2083-469a-883c-b4824a93ff63 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.611014 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fbea15d1-2083-469a-883c-b4824a93ff63 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.611440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fbea15d1-2083-469a-883c-b4824a93ff63 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.612143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fbea15d1-2083-469a-883c-b4824a93ff63 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.612589 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fbea15d1-2083-469a-883c-b4824a93ff63 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.613059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fbea15d1-2083-469a-883c-b4824a93ff63 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.679277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-fbea15d1-2083-469a-883c-b4824a93ff63 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "POST /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/action" status: 202 len: 0 microversion: 2.1 time: 0.078660 Aug 24 17:52:33.679840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 241/510] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:52:33 2022] POST /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:52:33.688111 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-98f3e8f6-e357-4ae5-bd98-304891d65c25 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:33.688748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-98f3e8f6-e357-4ae5-bd98-304891d65c25 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:33.695415 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98f3e8f6-e357-4ae5-bd98-304891d65c25 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.695885 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98f3e8f6-e357-4ae5-bd98-304891d65c25 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.696321 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98f3e8f6-e357-4ae5-bd98-304891d65c25 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.697058 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98f3e8f6-e357-4ae5-bd98-304891d65c25 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:33.697541 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98f3e8f6-e357-4ae5-bd98-304891d65c25 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:33.698011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98f3e8f6-e357-4ae5-bd98-304891d65c25 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:33.927211 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-98f3e8f6-e357-4ae5-bd98-304891d65c25 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:33.935527 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-98f3e8f6-e357-4ae5-bd98-304891d65c25 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1723 microversion: 2.1 time: 0.251192 Aug 24 17:52:33.936019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 270/511] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:33 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:34.957209 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1c7ce28b-a7a7-4949-8583-b40a6b172c72 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:34.957815 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1c7ce28b-a7a7-4949-8583-b40a6b172c72 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:34.964196 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1c7ce28b-a7a7-4949-8583-b40a6b172c72 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:34.964674 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1c7ce28b-a7a7-4949-8583-b40a6b172c72 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:34.965101 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1c7ce28b-a7a7-4949-8583-b40a6b172c72 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:34.965778 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1c7ce28b-a7a7-4949-8583-b40a6b172c72 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:34.966224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1c7ce28b-a7a7-4949-8583-b40a6b172c72 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:34.966646 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1c7ce28b-a7a7-4949-8583-b40a6b172c72 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:35.101993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1c7ce28b-a7a7-4949-8583-b40a6b172c72 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:35.110608 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1c7ce28b-a7a7-4949-8583-b40a6b172c72 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1723 microversion: 2.1 time: 0.158104 Aug 24 17:52:35.111635 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 242/512] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:34 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:36.132222 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0ed07f6f-832f-45e7-be4f-853d709fe2c8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:36.132734 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0ed07f6f-832f-45e7-be4f-853d709fe2c8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:36.139039 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ed07f6f-832f-45e7-be4f-853d709fe2c8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:36.139546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ed07f6f-832f-45e7-be4f-853d709fe2c8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:36.139980 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ed07f6f-832f-45e7-be4f-853d709fe2c8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:36.140656 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ed07f6f-832f-45e7-be4f-853d709fe2c8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:36.141103 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ed07f6f-832f-45e7-be4f-853d709fe2c8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:36.141522 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ed07f6f-832f-45e7-be4f-853d709fe2c8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:36.275076 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0ed07f6f-832f-45e7-be4f-853d709fe2c8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:36.283531 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0ed07f6f-832f-45e7-be4f-853d709fe2c8 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1723 microversion: 2.1 time: 0.155801 Aug 24 17:52:36.284100 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 271/513] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:36 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:37.305681 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-91d73a55-575a-49df-9b8c-df2057211081 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:37.306249 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-91d73a55-575a-49df-9b8c-df2057211081 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:37.312705 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-91d73a55-575a-49df-9b8c-df2057211081 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:37.313184 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-91d73a55-575a-49df-9b8c-df2057211081 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:37.313617 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-91d73a55-575a-49df-9b8c-df2057211081 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:37.314299 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-91d73a55-575a-49df-9b8c-df2057211081 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:37.314748 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-91d73a55-575a-49df-9b8c-df2057211081 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:37.315164 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-91d73a55-575a-49df-9b8c-df2057211081 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:37.446958 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-91d73a55-575a-49df-9b8c-df2057211081 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:37.455968 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-91d73a55-575a-49df-9b8c-df2057211081 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1729 microversion: 2.1 time: 0.154068 Aug 24 17:52:37.457140 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 243/514] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:52:37 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:37.477377 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d34ab657-9f42-413e-b101-46bc3587f3e6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:37.477868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d34ab657-9f42-413e-b101-46bc3587f3e6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:37.484263 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d34ab657-9f42-413e-b101-46bc3587f3e6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:37.484748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d34ab657-9f42-413e-b101-46bc3587f3e6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:37.485182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d34ab657-9f42-413e-b101-46bc3587f3e6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:37.485873 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d34ab657-9f42-413e-b101-46bc3587f3e6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:37.486332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d34ab657-9f42-413e-b101-46bc3587f3e6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:37.486761 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d34ab657-9f42-413e-b101-46bc3587f3e6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:37.562751 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d34ab657-9f42-413e-b101-46bc3587f3e6 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089123 Aug 24 17:52:37.563433 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 272/515] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 17:52:37 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:52:38.414047 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-fd58bbb7-40dc-4768-9b91-a7112a1a883f req-516ccc4c-54a9-4b61-ac4d-c7d4a00a6add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef24bd4c-630a-428f-9eb7-50c5009e9fe1", "tag": "22d0b6c6-ad45-4659-a4f0-1d8f89c1671d"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:38.424222 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-fd58bbb7-40dc-4768-9b91-a7112a1a883f req-516ccc4c-54a9-4b61-ac4d-c7d4a00a6add service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:38.424705 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-fd58bbb7-40dc-4768-9b91-a7112a1a883f req-516ccc4c-54a9-4b61-ac4d-c7d4a00a6add service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:38.425159 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-fd58bbb7-40dc-4768-9b91-a7112a1a883f req-516ccc4c-54a9-4b61-ac4d-c7d4a00a6add service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:38.436398 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-fd58bbb7-40dc-4768-9b91-a7112a1a883f req-516ccc4c-54a9-4b61-ac4d-c7d4a00a6add service nova] Creating event network-changed:22d0b6c6-ad45-4659-a4f0-1d8f89c1671d for instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 on hv-cinder-84052 Aug 24 17:52:38.442175 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-fd58bbb7-40dc-4768-9b91-a7112a1a883f req-516ccc4c-54a9-4b61-ac4d-c7d4a00a6add service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031701 Aug 24 17:52:38.442773 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 244/516] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:40.457341 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-f050f3bc-b33f-4777-a7c4-d18abccf067c req-b8db2b12-b983-4698-bcad-c2427a512fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef24bd4c-630a-428f-9eb7-50c5009e9fe1", "tag": "22d0b6c6-ad45-4659-a4f0-1d8f89c1671d"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:40.466757 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-f050f3bc-b33f-4777-a7c4-d18abccf067c req-b8db2b12-b983-4698-bcad-c2427a512fa4 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:40.467286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-f050f3bc-b33f-4777-a7c4-d18abccf067c req-b8db2b12-b983-4698-bcad-c2427a512fa4 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:40.467729 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-f050f3bc-b33f-4777-a7c4-d18abccf067c req-b8db2b12-b983-4698-bcad-c2427a512fa4 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:40.481959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-f050f3bc-b33f-4777-a7c4-d18abccf067c req-b8db2b12-b983-4698-bcad-c2427a512fa4 service nova] Creating event network-changed:22d0b6c6-ad45-4659-a4f0-1d8f89c1671d for instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 on hv-cinder-84052 Aug 24 17:52:40.487035 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-f050f3bc-b33f-4777-a7c4-d18abccf067c req-b8db2b12-b983-4698-bcad-c2427a512fa4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034462 Aug 24 17:52:40.487651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 273/517] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:43.503715 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e1aafe97-3109-4098-a14a-801f9f273632 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:43.504994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e1aafe97-3109-4098-a14a-801f9f273632 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:43.511459 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:43.513509 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e1aafe97-3109-4098-a14a-801f9f273632 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.513988 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e1aafe97-3109-4098-a14a-801f9f273632 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.515185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e1aafe97-3109-4098-a14a-801f9f273632 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.516139 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e1aafe97-3109-4098-a14a-801f9f273632 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.516749 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e1aafe97-3109-4098-a14a-801f9f273632 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.517313 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e1aafe97-3109-4098-a14a-801f9f273632 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.559962 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e1aafe97-3109-4098-a14a-801f9f273632 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/os-volume_attachments/51616b69-2660-4a49-91ed-0840d6d74f9a" status: 200 len: 194 microversion: 2.20 time: 0.060982 Aug 24 17:52:43.560893 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 245/518] 10.222.0.27 () {60 vars in 1454 bytes} [Wed Aug 24 17:52:43 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/os-volume_attachments/51616b69-2660-4a49-91ed-0840d6d74f9a => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:52:43.630512 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f9422d77-e26e-4468-bd27-8808ed3ccf20 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:43.631352 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f9422d77-e26e-4468-bd27-8808ed3ccf20 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:43.634064 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=39 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:43.639836 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f9422d77-e26e-4468-bd27-8808ed3ccf20 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.640676 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f9422d77-e26e-4468-bd27-8808ed3ccf20 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.641123 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f9422d77-e26e-4468-bd27-8808ed3ccf20 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.641837 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f9422d77-e26e-4468-bd27-8808ed3ccf20 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.642297 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f9422d77-e26e-4468-bd27-8808ed3ccf20 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.643063 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f9422d77-e26e-4468-bd27-8808ed3ccf20 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.734193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.objects.instance [None req-f9422d77-e26e-4468-bd27-8808ed3ccf20 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lazy-loading 'services' on Instance uuid 11705238-e9d4-4c1e-ab49-d5a27eb4df4c {{(pid=126994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:52:43.812800 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f9422d77-e26e-4468-bd27-8808ed3ccf20 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "DELETE /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/os-volume_attachments/51616b69-2660-4a49-91ed-0840d6d74f9a" status: 202 len: 0 microversion: 2.20 time: 0.186736 Aug 24 17:52:43.825197 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8c1f85de-7c8f-4f6e-afa1-fbc072c8b0d8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:43.827419 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8c1f85de-7c8f-4f6e-afa1-fbc072c8b0d8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:43.829425 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 274/519] 10.222.0.27 () {60 vars in 1457 bytes} [Wed Aug 24 17:52:43 2022] DELETE /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/os-volume_attachments/51616b69-2660-4a49-91ed-0840d6d74f9a => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:52:43.835026 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8c1f85de-7c8f-4f6e-afa1-fbc072c8b0d8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.835787 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8c1f85de-7c8f-4f6e-afa1-fbc072c8b0d8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.836382 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8c1f85de-7c8f-4f6e-afa1-fbc072c8b0d8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.837277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8c1f85de-7c8f-4f6e-afa1-fbc072c8b0d8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:43.837733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8c1f85de-7c8f-4f6e-afa1-fbc072c8b0d8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:43.838164 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8c1f85de-7c8f-4f6e-afa1-fbc072c8b0d8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:43.883120 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8c1f85de-7c8f-4f6e-afa1-fbc072c8b0d8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064481 Aug 24 17:52:43.884338 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 246/520] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 24 17:52:43 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:52:44.897424 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ee852f9e-9b09-40f6-8895-59001f0025f6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:44.900039 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ee852f9e-9b09-40f6-8895-59001f0025f6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:44.907003 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ee852f9e-9b09-40f6-8895-59001f0025f6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.907282 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ee852f9e-9b09-40f6-8895-59001f0025f6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.907765 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ee852f9e-9b09-40f6-8895-59001f0025f6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.908470 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ee852f9e-9b09-40f6-8895-59001f0025f6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:44.908988 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ee852f9e-9b09-40f6-8895-59001f0025f6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:44.909414 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ee852f9e-9b09-40f6-8895-59001f0025f6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:44.941552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ee852f9e-9b09-40f6-8895-59001f0025f6 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049387 Aug 24 17:52:44.942608 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 275/521] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 24 17:52:44 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:52:45.020459 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b978a474-5e63-4e4b-b600-9f4d283b885d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:45.021495 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b978a474-5e63-4e4b-b600-9f4d283b885d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:45.028497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b978a474-5e63-4e4b-b600-9f4d283b885d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:45.029260 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b978a474-5e63-4e4b-b600-9f4d283b885d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:45.029845 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b978a474-5e63-4e4b-b600-9f4d283b885d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:45.030722 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b978a474-5e63-4e4b-b600-9f4d283b885d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:45.031325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b978a474-5e63-4e4b-b600-9f4d283b885d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:45.031918 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b978a474-5e63-4e4b-b600-9f4d283b885d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:45.061266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b978a474-5e63-4e4b-b600-9f4d283b885d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:52:45.167903 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b978a474-5e63-4e4b-b600-9f4d283b885d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "DELETE /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 204 len: 0 microversion: 2.20 time: 0.151260 Aug 24 17:52:45.171559 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 247/522] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Aug 24 17:52:45 2022] DELETE /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:52:45.177843 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6f178f07-f637-4c3f-9901-5af7f3a359ea tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:45.178469 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-6f178f07-f637-4c3f-9901-5af7f3a359ea tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:45.184831 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6f178f07-f637-4c3f-9901-5af7f3a359ea tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:45.185319 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6f178f07-f637-4c3f-9901-5af7f3a359ea tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:45.185990 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6f178f07-f637-4c3f-9901-5af7f3a359ea tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:45.186882 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6f178f07-f637-4c3f-9901-5af7f3a359ea tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:45.187622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6f178f07-f637-4c3f-9901-5af7f3a359ea tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:45.188244 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6f178f07-f637-4c3f-9901-5af7f3a359ea tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:45.355858 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6f178f07-f637-4c3f-9901-5af7f3a359ea tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:45.359042 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:45.370930 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6f178f07-f637-4c3f-9901-5af7f3a359ea tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:45.373140 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6f178f07-f637-4c3f-9901-5af7f3a359ea tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:45.374526 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6f178f07-f637-4c3f-9901-5af7f3a359ea tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.201282 Aug 24 17:52:45.375802 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 276/523] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:45 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:46.403936 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5d1ef63a-50a6-4c63-81c2-12f9881d333f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:46.406053 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5d1ef63a-50a6-4c63-81c2-12f9881d333f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:46.413006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d1ef63a-50a6-4c63-81c2-12f9881d333f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:46.413727 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d1ef63a-50a6-4c63-81c2-12f9881d333f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:46.414340 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d1ef63a-50a6-4c63-81c2-12f9881d333f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:46.415651 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d1ef63a-50a6-4c63-81c2-12f9881d333f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:46.416113 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d1ef63a-50a6-4c63-81c2-12f9881d333f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:46.416699 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d1ef63a-50a6-4c63-81c2-12f9881d333f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:46.694046 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-5d1ef63a-50a6-4c63-81c2-12f9881d333f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:46.703261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-5d1ef63a-50a6-4c63-81c2-12f9881d333f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:46.705489 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-5d1ef63a-50a6-4c63-81c2-12f9881d333f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:46.707732 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5d1ef63a-50a6-4c63-81c2-12f9881d333f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1722 microversion: 2.20 time: 0.311514 Aug 24 17:52:46.708921 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 248/524] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:46 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:47.724215 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-abe84fa1-0c01-4d08-8668-863f01e5bd6c req-6ec79177-e664-4e6c-a038-307996e2c31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11705238-e9d4-4c1e-ab49-d5a27eb4df4c", "name": "network-vif-deleted", "tag": "41c4ee25-50fb-45d7-9866-1d83514f02d5"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:47.741253 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-68bb5329-fe59-410e-8511-86d47c740def tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:47.741874 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-68bb5329-fe59-410e-8511-86d47c740def tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:47.747002 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-abe84fa1-0c01-4d08-8668-863f01e5bd6c req-6ec79177-e664-4e6c-a038-307996e2c31a service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.747761 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-abe84fa1-0c01-4d08-8668-863f01e5bd6c req-6ec79177-e664-4e6c-a038-307996e2c31a service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.748430 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-abe84fa1-0c01-4d08-8668-863f01e5bd6c req-6ec79177-e664-4e6c-a038-307996e2c31a service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:47.753304 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-68bb5329-fe59-410e-8511-86d47c740def tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.753795 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-68bb5329-fe59-410e-8511-86d47c740def tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.754226 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-68bb5329-fe59-410e-8511-86d47c740def tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:47.754935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-68bb5329-fe59-410e-8511-86d47c740def tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:47.755383 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-68bb5329-fe59-410e-8511-86d47c740def tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:47.761797 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-68bb5329-fe59-410e-8511-86d47c740def tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:47.787934 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-abe84fa1-0c01-4d08-8668-863f01e5bd6c req-6ec79177-e664-4e6c-a038-307996e2c31a service nova] Creating event network-vif-deleted:41c4ee25-50fb-45d7-9866-1d83514f02d5 for instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c on hv-cinder-84052 Aug 24 17:52:47.796492 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-abe84fa1-0c01-4d08-8668-863f01e5bd6c req-6ec79177-e664-4e6c-a038-307996e2c31a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077352 Aug 24 17:52:47.797851 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 277/525] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:47.877697 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-68bb5329-fe59-410e-8511-86d47c740def tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:47.887442 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-68bb5329-fe59-410e-8511-86d47c740def tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:47.888983 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-68bb5329-fe59-410e-8511-86d47c740def tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:47.900308 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-68bb5329-fe59-410e-8511-86d47c740def tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 200 len: 1367 microversion: 2.20 time: 0.169548 Aug 24 17:52:47.901053 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 249/526] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:47 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:48.929349 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3be1a990-e310-4c3f-8ffb-4916fb86997f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:48.930264 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3be1a990-e310-4c3f-8ffb-4916fb86997f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:48.944258 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3be1a990-e310-4c3f-8ffb-4916fb86997f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:48.945989 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3be1a990-e310-4c3f-8ffb-4916fb86997f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:48.946642 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3be1a990-e310-4c3f-8ffb-4916fb86997f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:48.948674 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3be1a990-e310-4c3f-8ffb-4916fb86997f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:48.950207 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3be1a990-e310-4c3f-8ffb-4916fb86997f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:48.951114 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3be1a990-e310-4c3f-8ffb-4916fb86997f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:48.984598 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-3be1a990-e310-4c3f-8ffb-4916fb86997f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] HTTP exception thrown: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3be1a990-e310-4c3f-8ffb-4916fb86997f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Request method failure captured: Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c HTTP/1.1 Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmRYbj-V9PjcwdHOh-YrC14MjM_RwDiPR3OMvmlu7Ii547sAHMvTX2niMRnBTHkxQvpheTsVtifPHTsOvUC82sGzsD1Xvk6kF5Z8uKjViARbKj5U5sOu9yM9d6N5Kop0yLFOwJubHKSgFQlw_w2hO66kFTUE8clp0257Klecr8hP4IY Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 2fe3fa5e280d4fbd8a26cac05fe8aaa9 Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:52:48.988805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:52:48.990141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}] Aug 24 17:52:48.990141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:52:48.990141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 2fe3fa5e280d4fbd8a26cac05fe8aaa9 Aug 24 17:52:48.990141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:52:48.990141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-AttachVolumeShelveTestJSON-1674504252-project Aug 24 17:52:48.990141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:52:48.990141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:52:48.990141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 7813dcd78a38483682842ac199e1cd18 Aug 24 17:52:48.990141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674504252-project Aug 24 17:52:48.990141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:52:48.990141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:52:48.990141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '11705238-e9d4-4c1e-ab49-d5a27eb4df4c'} Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:52:48.990901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:52:48.992135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:52:48.993241 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3be1a990-e310-4c3f-8ffb-4916fb86997f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Returning 404 to user: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:52:48.993241 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3be1a990-e310-4c3f-8ffb-4916fb86997f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 404 len: 111 microversion: 2.20 time: 0.069596 Aug 24 17:52:48.998201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 278/527] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:48 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:52:49.001142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-46279f1d-da98-4e95-b634-7995c2b71200 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '.version_select at 0x7f4b2a048b80>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:49.059551 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-46279f1d-da98-4e95-b634-7995c2b71200 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554621386" status: 204 len: 0 microversion: 2.20 time: 0.062403 Aug 24 17:52:49.060213 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 250/528] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Aug 24 17:52:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554621386 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 17:52:50.177808 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-43c49d15-45bd-4d9c-80d3-5367d1043e86 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Action: 'create', calling method: .version_select at 0x7f4b29878820>, body: {"keypair": {"name": "tempest-keypair-149252560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmKYmnbmo96gpRzu938WO849X4A4VEPnAFvdYRhiw2DTsPoIxNr3cfbZ8BeclQNoOvAsAHWX7SOlWNoposNyLROc+2YnQTnt5SQ7RUgO+peoNryh9KhbmqBPhCv9ejndQ=="}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:50.210957 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-43c49d15-45bd-4d9c-80d3-5367d1043e86 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Getting quotas for project 2fe3fa5e280d4fbd8a26cac05fe8aaa9. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:52:50.223938 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-43c49d15-45bd-4d9c-80d3-5367d1043e86 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Getting quotas for user 7813dcd78a38483682842ac199e1cd18 and project 2fe3fa5e280d4fbd8a26cac05fe8aaa9. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:52:50.266997 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-43c49d15-45bd-4d9c-80d3-5367d1043e86 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.097427 Aug 24 17:52:50.267751 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 279/529] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Aug 24 17:52:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 17:52:52.792262 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-153861353", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4887da7-fc9b-4bdc-bef8-72d9aff23bba"}], "security_groups": [{"name": "tempest-securitygroup--551029983"}], "key_name": "tempest-keypair-149252560", "user_data": "}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:52.996925 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] validate_networks() for [('b4887da7-fc9b-4bdc-bef8-72d9aff23bba', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:52:53.725315 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:52:53.725740 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:52:53.726215 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:52:53.726630 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:52:53.727041 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:52:53.737168 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:53.738127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:53.738575 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:53.739321 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:53.739798 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:53.740392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:53.760181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Getting quotas for project 2fe3fa5e280d4fbd8a26cac05fe8aaa9. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:52:53.764585 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Getting quotas for user 7813dcd78a38483682842ac199e1cd18 and project 2fe3fa5e280d4fbd8a26cac05fe8aaa9. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:52:53.776850 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:52:53.779245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:52:53.829921 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-dc695ef5-db7a-4ebb-94ed-7894d9684671 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.042133 Aug 24 17:52:53.830920 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 251/530] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Aug 24 17:52:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 17:52:53.842399 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0f0dc1fd-cad2-48fb-9f74-8c1b8d49d1fd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:53.843126 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0f0dc1fd-cad2-48fb-9f74-8c1b8d49d1fd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:54.210091 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0f0dc1fd-cad2-48fb-9f74-8c1b8d49d1fd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:54.217801 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0f0dc1fd-cad2-48fb-9f74-8c1b8d49d1fd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:54.219324 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0f0dc1fd-cad2-48fb-9f74-8c1b8d49d1fd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:54.222146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0f0dc1fd-cad2-48fb-9f74-8c1b8d49d1fd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1280 microversion: 2.20 time: 0.384189 Aug 24 17:52:54.222706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 280/531] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:53 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1280 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:55.246140 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2bea0faa-ce9e-421f-848c-ae4eee0d4bad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:55.247506 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2bea0faa-ce9e-421f-848c-ae4eee0d4bad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:55.258988 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2bea0faa-ce9e-421f-848c-ae4eee0d4bad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:55.261519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2bea0faa-ce9e-421f-848c-ae4eee0d4bad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:55.262153 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2bea0faa-ce9e-421f-848c-ae4eee0d4bad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:55.263029 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2bea0faa-ce9e-421f-848c-ae4eee0d4bad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:55.266201 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2bea0faa-ce9e-421f-848c-ae4eee0d4bad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:55.266911 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2bea0faa-ce9e-421f-848c-ae4eee0d4bad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:55.393558 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2bea0faa-ce9e-421f-848c-ae4eee0d4bad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:55.409486 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2bea0faa-ce9e-421f-848c-ae4eee0d4bad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:55.414096 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2bea0faa-ce9e-421f-848c-ae4eee0d4bad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:55.417043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2bea0faa-ce9e-421f-848c-ae4eee0d4bad tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1350 microversion: 2.20 time: 0.175469 Aug 24 17:52:55.421425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 252/532] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:55 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1350 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:56.446569 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8e38e15d-c5b4-4741-a39f-1fe52dedc0b4 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:56.447794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8e38e15d-c5b4-4741-a39f-1fe52dedc0b4 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:56.460422 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8e38e15d-c5b4-4741-a39f-1fe52dedc0b4 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:56.461188 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8e38e15d-c5b4-4741-a39f-1fe52dedc0b4 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:56.463715 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8e38e15d-c5b4-4741-a39f-1fe52dedc0b4 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:56.464771 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8e38e15d-c5b4-4741-a39f-1fe52dedc0b4 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:56.469972 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8e38e15d-c5b4-4741-a39f-1fe52dedc0b4 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:56.470822 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8e38e15d-c5b4-4741-a39f-1fe52dedc0b4 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:56.791077 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8e38e15d-c5b4-4741-a39f-1fe52dedc0b4 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:56.801870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8e38e15d-c5b4-4741-a39f-1fe52dedc0b4 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:56.804203 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8e38e15d-c5b4-4741-a39f-1fe52dedc0b4 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:56.805830 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8e38e15d-c5b4-4741-a39f-1fe52dedc0b4 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1405 microversion: 2.20 time: 0.363171 Aug 24 17:52:56.806390 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 281/533] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:56 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1405 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:57.098381 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-2174be2f-0257-4870-9d83-cba7cf8a395c req-0ba84995-d5a6-4959-999e-adfaef3dddbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34147b78-b9f5-4566-8d38-f0ed7ef27e7f", "tag": "2ae11597-17eb-4280-8c34-d47ce491867b"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:52:57.120051 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-2174be2f-0257-4870-9d83-cba7cf8a395c req-0ba84995-d5a6-4959-999e-adfaef3dddbc service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.130980 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-2174be2f-0257-4870-9d83-cba7cf8a395c req-0ba84995-d5a6-4959-999e-adfaef3dddbc service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.131988 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-2174be2f-0257-4870-9d83-cba7cf8a395c req-0ba84995-d5a6-4959-999e-adfaef3dddbc service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.150042 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-2174be2f-0257-4870-9d83-cba7cf8a395c req-0ba84995-d5a6-4959-999e-adfaef3dddbc service nova] Creating event network-changed:2ae11597-17eb-4280-8c34-d47ce491867b for instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f on hv-cinder-84052 Aug 24 17:52:57.155609 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-2174be2f-0257-4870-9d83-cba7cf8a395c req-0ba84995-d5a6-4959-999e-adfaef3dddbc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060678 Aug 24 17:52:57.156966 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 253/534] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:52:57.828876 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fda26063-6c4b-4c07-b85c-a7b785472fdb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:57.829485 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-fda26063-6c4b-4c07-b85c-a7b785472fdb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:57.841269 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fda26063-6c4b-4c07-b85c-a7b785472fdb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.842422 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fda26063-6c4b-4c07-b85c-a7b785472fdb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.842863 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fda26063-6c4b-4c07-b85c-a7b785472fdb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:57.843605 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fda26063-6c4b-4c07-b85c-a7b785472fdb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:57.844329 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fda26063-6c4b-4c07-b85c-a7b785472fdb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:57.844927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fda26063-6c4b-4c07-b85c-a7b785472fdb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:58.020489 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fda26063-6c4b-4c07-b85c-a7b785472fdb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:58.029923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fda26063-6c4b-4c07-b85c-a7b785472fdb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:58.032693 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fda26063-6c4b-4c07-b85c-a7b785472fdb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:58.034645 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-fda26063-6c4b-4c07-b85c-a7b785472fdb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1405 microversion: 2.20 time: 0.209919 Aug 24 17:52:58.047502 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 282/535] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:57 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:52:59.058650 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-32ada50d-620d-43bd-8fe0-4cefb596a5b9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:52:59.059410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-32ada50d-620d-43bd-8fe0-4cefb596a5b9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:52:59.072407 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-32ada50d-620d-43bd-8fe0-4cefb596a5b9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:59.073225 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-32ada50d-620d-43bd-8fe0-4cefb596a5b9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:59.073833 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-32ada50d-620d-43bd-8fe0-4cefb596a5b9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:59.074714 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-32ada50d-620d-43bd-8fe0-4cefb596a5b9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:52:59.075322 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-32ada50d-620d-43bd-8fe0-4cefb596a5b9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:52:59.076244 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-32ada50d-620d-43bd-8fe0-4cefb596a5b9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:52:59.108040 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:52:59.298642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-32ada50d-620d-43bd-8fe0-4cefb596a5b9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:59.308472 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-32ada50d-620d-43bd-8fe0-4cefb596a5b9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:59.310255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-32ada50d-620d-43bd-8fe0-4cefb596a5b9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:52:59.311835 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-32ada50d-620d-43bd-8fe0-4cefb596a5b9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1405 microversion: 2.20 time: 0.257145 Aug 24 17:52:59.315552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 254/536] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:52:59 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1405 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:00.335152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fb327530-e7cc-4e08-8d44-a19d4e990c95 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:00.335808 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-fb327530-e7cc-4e08-8d44-a19d4e990c95 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:00.342534 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fb327530-e7cc-4e08-8d44-a19d4e990c95 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:00.343023 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fb327530-e7cc-4e08-8d44-a19d4e990c95 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:00.343687 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fb327530-e7cc-4e08-8d44-a19d4e990c95 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.344562 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fb327530-e7cc-4e08-8d44-a19d4e990c95 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:00.345226 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fb327530-e7cc-4e08-8d44-a19d4e990c95 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:00.345862 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fb327530-e7cc-4e08-8d44-a19d4e990c95 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:00.487297 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fb327530-e7cc-4e08-8d44-a19d4e990c95 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:00.496145 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fb327530-e7cc-4e08-8d44-a19d4e990c95 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:00.498022 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fb327530-e7cc-4e08-8d44-a19d4e990c95 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:00.499249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-fb327530-e7cc-4e08-8d44-a19d4e990c95 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1405 microversion: 2.20 time: 0.168343 Aug 24 17:53:00.499909 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 283/537] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:00 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:01.522748 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-da0fd281-6ad7-447e-a68c-dfc5a5ac1bc9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:01.524554 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-da0fd281-6ad7-447e-a68c-dfc5a5ac1bc9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:01.533989 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-da0fd281-6ad7-447e-a68c-dfc5a5ac1bc9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.534505 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-da0fd281-6ad7-447e-a68c-dfc5a5ac1bc9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.534952 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-da0fd281-6ad7-447e-a68c-dfc5a5ac1bc9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.535714 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-da0fd281-6ad7-447e-a68c-dfc5a5ac1bc9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:01.536171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-da0fd281-6ad7-447e-a68c-dfc5a5ac1bc9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:01.536959 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-da0fd281-6ad7-447e-a68c-dfc5a5ac1bc9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:01.699719 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-da0fd281-6ad7-447e-a68c-dfc5a5ac1bc9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:01.709250 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-da0fd281-6ad7-447e-a68c-dfc5a5ac1bc9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:01.711906 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-da0fd281-6ad7-447e-a68c-dfc5a5ac1bc9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:01.713279 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-da0fd281-6ad7-447e-a68c-dfc5a5ac1bc9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1405 microversion: 2.20 time: 0.194444 Aug 24 17:53:01.714013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 255/538] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:01 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:02.737129 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0ca2879e-b4ac-4db8-bdec-afac17b2cdaf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:02.737744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0ca2879e-b4ac-4db8-bdec-afac17b2cdaf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:02.744448 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ca2879e-b4ac-4db8-bdec-afac17b2cdaf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:02.745004 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ca2879e-b4ac-4db8-bdec-afac17b2cdaf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:02.745451 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ca2879e-b4ac-4db8-bdec-afac17b2cdaf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:02.746152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ca2879e-b4ac-4db8-bdec-afac17b2cdaf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:02.746901 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ca2879e-b4ac-4db8-bdec-afac17b2cdaf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:02.747578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0ca2879e-b4ac-4db8-bdec-afac17b2cdaf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:02.891915 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0ca2879e-b4ac-4db8-bdec-afac17b2cdaf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:02.901957 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0ca2879e-b4ac-4db8-bdec-afac17b2cdaf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:02.903608 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0ca2879e-b4ac-4db8-bdec-afac17b2cdaf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:02.904713 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0ca2879e-b4ac-4db8-bdec-afac17b2cdaf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1405 microversion: 2.20 time: 0.171580 Aug 24 17:53:02.919507 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 284/539] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:02 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:03.198603 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-7a92a01d-f1f5-4709-8746-289749c9f089 req-449d46f1-2d93-4961-a92a-763009c1245a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34147b78-b9f5-4566-8d38-f0ed7ef27e7f", "name": "network-vif-plugged", "status": "completed", "tag": "2ae11597-17eb-4280-8c34-d47ce491867b"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:03.214474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-7a92a01d-f1f5-4709-8746-289749c9f089 req-449d46f1-2d93-4961-a92a-763009c1245a service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.215209 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-7a92a01d-f1f5-4709-8746-289749c9f089 req-449d46f1-2d93-4961-a92a-763009c1245a service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.215958 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-7a92a01d-f1f5-4709-8746-289749c9f089 req-449d46f1-2d93-4961-a92a-763009c1245a service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.228747 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-7a92a01d-f1f5-4709-8746-289749c9f089 req-449d46f1-2d93-4961-a92a-763009c1245a service nova] Creating event network-vif-plugged:2ae11597-17eb-4280-8c34-d47ce491867b for instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f on hv-cinder-84052 Aug 24 17:53:03.234310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-7a92a01d-f1f5-4709-8746-289749c9f089 req-449d46f1-2d93-4961-a92a-763009c1245a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039994 Aug 24 17:53:03.235336 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 256/540] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:03.930864 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4d1d0a04-6cd0-4cf0-9160-e209550e929f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:03.931793 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4d1d0a04-6cd0-4cf0-9160-e209550e929f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:03.939165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d1d0a04-6cd0-4cf0-9160-e209550e929f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.939701 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d1d0a04-6cd0-4cf0-9160-e209550e929f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.940143 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d1d0a04-6cd0-4cf0-9160-e209550e929f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.940841 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d1d0a04-6cd0-4cf0-9160-e209550e929f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:03.941296 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d1d0a04-6cd0-4cf0-9160-e209550e929f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:03.941716 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d1d0a04-6cd0-4cf0-9160-e209550e929f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:03.972379 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:03.973733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=6 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:03.978357 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0bedcf8b-fc23-4927-a704-0446cda738f2 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Action: 'create', calling method: .version_select at 0x7f4b2a09ec10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-965320784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQFAaSrJf72wIbf8BH3/alpUpRPpKWA0/oKBvLtIrorTGfXyvxHTlxjIlRHW227YQxejfThD36fOcvMGJsywYHukIWimC8pt8H02VIARvsvztvv8cvWLcWG5eoRqasyeA=="}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:03.999762 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-0bedcf8b-fc23-4927-a704-0446cda738f2 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Getting quotas for project e78c5560d7874c7d9ae11d1a078090d9. Resources: {'key_pairs'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:53:04.004260 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-0bedcf8b-fc23-4927-a704-0446cda738f2 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Getting quotas for user f07443b7cf95488a9ccb84895a63b92e and project e78c5560d7874c7d9ae11d1a078090d9. Resources: {'key_pairs'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:53:04.027578 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0bedcf8b-fc23-4927-a704-0446cda738f2 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056003 Aug 24 17:53:04.028181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 257/541] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 17:53:03 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:04.077330 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4d1d0a04-6cd0-4cf0-9160-e209550e929f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:04.080181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2070984418", "imageRef": "58414fcd-f409-4e6a-9381-a0b78167a97d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-965320784", "networks": [{"uuid": "5a577f69-19df-42ad-a735-e23f9d18bb40"}]}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:04.086034 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4d1d0a04-6cd0-4cf0-9160-e209550e929f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:04.087670 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4d1d0a04-6cd0-4cf0-9160-e209550e929f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:04.088956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4d1d0a04-6cd0-4cf0-9160-e209550e929f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1405 microversion: 2.20 time: 0.162480 Aug 24 17:53:04.089543 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 285/542] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:03 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:04.132085 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] validate_networks() for [('5a577f69-19df-42ad-a735-e23f9d18bb40', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:53:04.502970 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:53:04.503582 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:53:04.503893 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:53:04.504297 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:53:04.504702 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:53:04.513294 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.513775 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.514209 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.514931 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:04.515391 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:04.515845 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:04.535369 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Getting quotas for project e78c5560d7874c7d9ae11d1a078090d9. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:53:04.539358 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Getting quotas for user f07443b7cf95488a9ccb84895a63b92e and project e78c5560d7874c7d9ae11d1a078090d9. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:53:04.550756 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:53:04.553139 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='58414fcd-f409-4e6a-9381-a0b78167a97d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:53:04.598767 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-3d2c11be-d39a-4eba-872a-ce02245aa161 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522408 Aug 24 17:53:04.599409 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 258/543] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:53:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:53:04.611331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c94a2905-076e-420b-b8e8-ff02a447338c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:04.612020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c94a2905-076e-420b-b8e8-ff02a447338c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:04.615125 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=6 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:04.668904 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c94a2905-076e-420b-b8e8-ff02a447338c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:04.676301 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c94a2905-076e-420b-b8e8-ff02a447338c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1258 microversion: 2.1 time: 0.069426 Aug 24 17:53:04.676898 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 286/544] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:04 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:05.111536 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0980fc78-2f0d-425c-b3e8-87ef7516d1a2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:05.112407 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0980fc78-2f0d-425c-b3e8-87ef7516d1a2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:05.122474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0980fc78-2f0d-425c-b3e8-87ef7516d1a2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.123111 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0980fc78-2f0d-425c-b3e8-87ef7516d1a2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.123835 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0980fc78-2f0d-425c-b3e8-87ef7516d1a2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.125496 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0980fc78-2f0d-425c-b3e8-87ef7516d1a2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.127361 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0980fc78-2f0d-425c-b3e8-87ef7516d1a2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.127827 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0980fc78-2f0d-425c-b3e8-87ef7516d1a2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.274719 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0980fc78-2f0d-425c-b3e8-87ef7516d1a2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:05.284045 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0980fc78-2f0d-425c-b3e8-87ef7516d1a2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:05.285550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0980fc78-2f0d-425c-b3e8-87ef7516d1a2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:05.286747 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0980fc78-2f0d-425c-b3e8-87ef7516d1a2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1597 microversion: 2.20 time: 0.179630 Aug 24 17:53:05.287304 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 259/545] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:05 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1597 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:05.309903 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-453fce99-2b8b-405d-ab29-e1f2720090ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:05.311125 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-453fce99-2b8b-405d-ab29-e1f2720090ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:05.318674 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-453fce99-2b8b-405d-ab29-e1f2720090ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.319536 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-453fce99-2b8b-405d-ab29-e1f2720090ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.320235 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-453fce99-2b8b-405d-ab29-e1f2720090ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.321180 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-453fce99-2b8b-405d-ab29-e1f2720090ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.321929 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-453fce99-2b8b-405d-ab29-e1f2720090ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.322557 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-453fce99-2b8b-405d-ab29-e1f2720090ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.402571 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-453fce99-2b8b-405d-ab29-e1f2720090ce tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097437 Aug 24 17:53:05.403254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 287/546] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Aug 24 17:53:05 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:53:05.697309 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-de1487b8-df49-47d4-acaf-51fa05378f02 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:05.697924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-de1487b8-df49-47d4-acaf-51fa05378f02 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:05.714422 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de1487b8-df49-47d4-acaf-51fa05378f02 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.715575 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de1487b8-df49-47d4-acaf-51fa05378f02 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.717077 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de1487b8-df49-47d4-acaf-51fa05378f02 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.718210 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de1487b8-df49-47d4-acaf-51fa05378f02 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:05.719032 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de1487b8-df49-47d4-acaf-51fa05378f02 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:05.720255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de1487b8-df49-47d4-acaf-51fa05378f02 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:05.820577 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-de1487b8-df49-47d4-acaf-51fa05378f02 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:05.832072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-de1487b8-df49-47d4-acaf-51fa05378f02 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1328 microversion: 2.1 time: 0.138485 Aug 24 17:53:05.832656 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 260/547] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:05 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1328 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:06.854183 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ddb3f17a-205b-4b6e-a6e6-1359a9090c27 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:06.854714 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ddb3f17a-205b-4b6e-a6e6-1359a9090c27 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:06.872996 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ddb3f17a-205b-4b6e-a6e6-1359a9090c27 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.877188 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ddb3f17a-205b-4b6e-a6e6-1359a9090c27 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.880536 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ddb3f17a-205b-4b6e-a6e6-1359a9090c27 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:06.881475 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ddb3f17a-205b-4b6e-a6e6-1359a9090c27 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:06.884679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ddb3f17a-205b-4b6e-a6e6-1359a9090c27 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:06.885343 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ddb3f17a-205b-4b6e-a6e6-1359a9090c27 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.136227 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-f02e2b3b-6046-40eb-aae9-ed00f0da3bce req-19f5b551-8c26-4330-b43d-246e933869b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34147b78-b9f5-4566-8d38-f0ed7ef27e7f", "tag": "2ae11597-17eb-4280-8c34-d47ce491867b"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:07.146966 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-f02e2b3b-6046-40eb-aae9-ed00f0da3bce req-19f5b551-8c26-4330-b43d-246e933869b8 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:07.147624 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-f02e2b3b-6046-40eb-aae9-ed00f0da3bce req-19f5b551-8c26-4330-b43d-246e933869b8 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:07.148256 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-f02e2b3b-6046-40eb-aae9-ed00f0da3bce req-19f5b551-8c26-4330-b43d-246e933869b8 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:07.161217 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-f02e2b3b-6046-40eb-aae9-ed00f0da3bce req-19f5b551-8c26-4330-b43d-246e933869b8 service nova] Creating event network-changed:2ae11597-17eb-4280-8c34-d47ce491867b for instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f on hv-cinder-84052 Aug 24 17:53:07.165347 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ddb3f17a-205b-4b6e-a6e6-1359a9090c27 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:07.167158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-f02e2b3b-6046-40eb-aae9-ed00f0da3bce req-19f5b551-8c26-4330-b43d-246e933869b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035115 Aug 24 17:53:07.168014 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 261/548] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:07.174199 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ddb3f17a-205b-4b6e-a6e6-1359a9090c27 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.323369 Aug 24 17:53:07.174771 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 288/549] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:06 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:08.197767 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4606da69-5661-4682-8291-e506ea868107 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:08.199097 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4606da69-5661-4682-8291-e506ea868107 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:08.211792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4606da69-5661-4682-8291-e506ea868107 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:08.212542 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4606da69-5661-4682-8291-e506ea868107 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:08.213129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4606da69-5661-4682-8291-e506ea868107 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:08.213994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4606da69-5661-4682-8291-e506ea868107 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:08.214599 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4606da69-5661-4682-8291-e506ea868107 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:08.215202 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4606da69-5661-4682-8291-e506ea868107 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:08.364803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4606da69-5661-4682-8291-e506ea868107 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:08.381546 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4606da69-5661-4682-8291-e506ea868107 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.182950 Aug 24 17:53:08.382179 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 262/550] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:08 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:09.402356 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f7357d32-5e24-466c-bb7f-628341ca274d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:09.402980 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f7357d32-5e24-466c-bb7f-628341ca274d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:09.410465 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f7357d32-5e24-466c-bb7f-628341ca274d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:09.410950 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f7357d32-5e24-466c-bb7f-628341ca274d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:09.411384 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f7357d32-5e24-466c-bb7f-628341ca274d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:09.412118 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f7357d32-5e24-466c-bb7f-628341ca274d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:09.412568 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f7357d32-5e24-466c-bb7f-628341ca274d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:09.412988 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f7357d32-5e24-466c-bb7f-628341ca274d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:09.558663 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f7357d32-5e24-466c-bb7f-628341ca274d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:09.566554 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f7357d32-5e24-466c-bb7f-628341ca274d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.168016 Aug 24 17:53:09.567124 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 289/551] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:09 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:10.589283 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7057b15a-ce6a-4e84-b363-a7e79170e8e5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:10.589951 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7057b15a-ce6a-4e84-b363-a7e79170e8e5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:10.602002 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7057b15a-ce6a-4e84-b363-a7e79170e8e5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.602511 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7057b15a-ce6a-4e84-b363-a7e79170e8e5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.603015 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7057b15a-ce6a-4e84-b363-a7e79170e8e5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.603944 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7057b15a-ce6a-4e84-b363-a7e79170e8e5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.604225 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7057b15a-ce6a-4e84-b363-a7e79170e8e5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.604649 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7057b15a-ce6a-4e84-b363-a7e79170e8e5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.763181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7057b15a-ce6a-4e84-b363-a7e79170e8e5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:10.771592 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7057b15a-ce6a-4e84-b363-a7e79170e8e5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.186064 Aug 24 17:53:10.782116 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 263/552] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:10 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:10.864270 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f7a3bc03-7b73-40c4-890e-c19c21bf853a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:10.864843 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f7a3bc03-7b73-40c4-890e-c19c21bf853a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:10.871812 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f7a3bc03-7b73-40c4-890e-c19c21bf853a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.872304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f7a3bc03-7b73-40c4-890e-c19c21bf853a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.872744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f7a3bc03-7b73-40c4-890e-c19c21bf853a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.873453 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f7a3bc03-7b73-40c4-890e-c19c21bf853a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:10.873910 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f7a3bc03-7b73-40c4-890e-c19c21bf853a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:10.874337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f7a3bc03-7b73-40c4-890e-c19c21bf853a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:10.960196 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.objects.instance [None req-f7a3bc03-7b73-40c4-890e-c19c21bf853a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lazy-loading 'services' on Instance uuid ef24bd4c-630a-428f-9eb7-50c5009e9fe1 {{(pid=126994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:11.046566 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f7a3bc03-7b73-40c4-890e-c19c21bf853a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments/2cc9ba26-34c2-4837-ab76-541b73d07c25" status: 202 len: 0 microversion: 2.1 time: 0.186653 Aug 24 17:53:11.050343 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 290/553] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 17:53:10 2022] DELETE /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments/2cc9ba26-34c2-4837-ab76-541b73d07c25 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:53:11.055760 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c921c288-c919-485c-886e-817b907fafce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:11.057957 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c921c288-c919-485c-886e-817b907fafce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:11.064833 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c921c288-c919-485c-886e-817b907fafce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:11.065307 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c921c288-c919-485c-886e-817b907fafce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:11.065918 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c921c288-c919-485c-886e-817b907fafce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:11.066830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c921c288-c919-485c-886e-817b907fafce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:11.067289 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c921c288-c919-485c-886e-817b907fafce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:11.067740 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c921c288-c919-485c-886e-817b907fafce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:11.100468 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c921c288-c919-485c-886e-817b907fafce tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048732 Aug 24 17:53:11.101260 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 264/554] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:53:11 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:11.794974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a1796fac-e8f5-4b7d-9211-54184aa67d3a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:11.795734 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a1796fac-e8f5-4b7d-9211-54184aa67d3a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:11.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1796fac-e8f5-4b7d-9211-54184aa67d3a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:11.803299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1796fac-e8f5-4b7d-9211-54184aa67d3a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:11.803760 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1796fac-e8f5-4b7d-9211-54184aa67d3a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:11.804457 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1796fac-e8f5-4b7d-9211-54184aa67d3a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:11.804909 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1796fac-e8f5-4b7d-9211-54184aa67d3a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:11.805331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a1796fac-e8f5-4b7d-9211-54184aa67d3a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:11.950526 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a1796fac-e8f5-4b7d-9211-54184aa67d3a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:11.959942 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a1796fac-e8f5-4b7d-9211-54184aa67d3a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.169082 Aug 24 17:53:11.968071 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 291/555] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:11 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:12.113685 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1b3f40e5-6842-4564-9bb5-689613250545 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:12.115750 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1b3f40e5-6842-4564-9bb5-689613250545 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:12.122484 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1b3f40e5-6842-4564-9bb5-689613250545 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.123094 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1b3f40e5-6842-4564-9bb5-689613250545 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.123634 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1b3f40e5-6842-4564-9bb5-689613250545 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:12.124452 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1b3f40e5-6842-4564-9bb5-689613250545 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.124910 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1b3f40e5-6842-4564-9bb5-689613250545 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.125330 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1b3f40e5-6842-4564-9bb5-689613250545 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:12.161787 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1b3f40e5-6842-4564-9bb5-689613250545 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052726 Aug 24 17:53:12.162350 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 265/556] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:53:12 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:12.981130 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-98faadd9-6513-4acb-9379-4d2b1e4def5e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:12.981906 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-98faadd9-6513-4acb-9379-4d2b1e4def5e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:12.993132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98faadd9-6513-4acb-9379-4d2b1e4def5e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.993631 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98faadd9-6513-4acb-9379-4d2b1e4def5e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.994162 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98faadd9-6513-4acb-9379-4d2b1e4def5e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:12.994905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98faadd9-6513-4acb-9379-4d2b1e4def5e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:12.995359 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98faadd9-6513-4acb-9379-4d2b1e4def5e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:12.995829 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98faadd9-6513-4acb-9379-4d2b1e4def5e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.141303 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-98faadd9-6513-4acb-9379-4d2b1e4def5e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:13.149179 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-98faadd9-6513-4acb-9379-4d2b1e4def5e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.172192 Aug 24 17:53:13.149942 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 292/557] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:12 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:13.174490 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8381b948-f306-4e6f-b99c-808abf93237c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:13.176799 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8381b948-f306-4e6f-b99c-808abf93237c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:13.183558 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8381b948-f306-4e6f-b99c-808abf93237c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.184041 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8381b948-f306-4e6f-b99c-808abf93237c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.184471 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8381b948-f306-4e6f-b99c-808abf93237c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.185190 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8381b948-f306-4e6f-b99c-808abf93237c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:13.185635 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8381b948-f306-4e6f-b99c-808abf93237c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:13.186050 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8381b948-f306-4e6f-b99c-808abf93237c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:13.231916 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8381b948-f306-4e6f-b99c-808abf93237c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061916 Aug 24 17:53:13.232505 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 266/558] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:53:13 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:14.170424 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6f1228c9-e795-421e-92e9-8aba67c94c4c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:14.172014 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-6f1228c9-e795-421e-92e9-8aba67c94c4c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:14.174816 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:14.181391 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6f1228c9-e795-421e-92e9-8aba67c94c4c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:14.182421 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6f1228c9-e795-421e-92e9-8aba67c94c4c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:14.183093 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6f1228c9-e795-421e-92e9-8aba67c94c4c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:14.184094 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6f1228c9-e795-421e-92e9-8aba67c94c4c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:14.184813 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6f1228c9-e795-421e-92e9-8aba67c94c4c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:14.185459 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6f1228c9-e795-421e-92e9-8aba67c94c4c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:14.244929 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-52178d3f-91a5-47db-8d03-97b5cc9b89de tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:14.247272 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-52178d3f-91a5-47db-8d03-97b5cc9b89de tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:14.251709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:14.256324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-52178d3f-91a5-47db-8d03-97b5cc9b89de tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:14.257660 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-52178d3f-91a5-47db-8d03-97b5cc9b89de tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:14.258111 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-52178d3f-91a5-47db-8d03-97b5cc9b89de tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:14.258830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-52178d3f-91a5-47db-8d03-97b5cc9b89de tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:14.259985 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-52178d3f-91a5-47db-8d03-97b5cc9b89de tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:14.260429 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-52178d3f-91a5-47db-8d03-97b5cc9b89de tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:14.313285 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-52178d3f-91a5-47db-8d03-97b5cc9b89de tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072597 Aug 24 17:53:14.314836 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 267/559] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:53:14 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:14.342062 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6f1228c9-e795-421e-92e9-8aba67c94c4c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:14.349981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6f1228c9-e795-421e-92e9-8aba67c94c4c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.183601 Aug 24 17:53:14.350635 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 293/560] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:14 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:15.326112 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-efbdd885-c2a7-484f-93a7-5220ed093a00 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:15.328272 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-efbdd885-c2a7-484f-93a7-5220ed093a00 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:15.330172 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:15.331105 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=10 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:15.337813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-efbdd885-c2a7-484f-93a7-5220ed093a00 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:15.338307 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-efbdd885-c2a7-484f-93a7-5220ed093a00 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:15.338745 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-efbdd885-c2a7-484f-93a7-5220ed093a00 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:15.339701 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-efbdd885-c2a7-484f-93a7-5220ed093a00 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:15.340164 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-efbdd885-c2a7-484f-93a7-5220ed093a00 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:15.340592 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-efbdd885-c2a7-484f-93a7-5220ed093a00 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:15.372667 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-efbdd885-c2a7-484f-93a7-5220ed093a00 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050478 Aug 24 17:53:15.373095 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7ff6a7de-0528-434b-b9d9-41b91e2d4653 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:15.373598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 268/561] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:53:15 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:15.378973 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7ff6a7de-0528-434b-b9d9-41b91e2d4653 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:15.383345 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:15.389955 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7ff6a7de-0528-434b-b9d9-41b91e2d4653 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:15.390564 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7ff6a7de-0528-434b-b9d9-41b91e2d4653 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:15.391097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7ff6a7de-0528-434b-b9d9-41b91e2d4653 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:15.391956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7ff6a7de-0528-434b-b9d9-41b91e2d4653 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:15.392481 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7ff6a7de-0528-434b-b9d9-41b91e2d4653 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:15.392911 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7ff6a7de-0528-434b-b9d9-41b91e2d4653 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:15.530111 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7ff6a7de-0528-434b-b9d9-41b91e2d4653 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:15.539255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7ff6a7de-0528-434b-b9d9-41b91e2d4653 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.171427 Aug 24 17:53:15.539862 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 294/562] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:15 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:15.944798 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-2cefe9c0-6ade-4dcc-9585-b4a2aa49bbb7 req-e3b01462-b01b-404a-8187-57f8248f7407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3051bbe9-8766-4204-9998-a496565cfc22", "tag": "dcaa2642-5d4e-4109-91ed-2b174f78eea6"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:15.956066 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-2cefe9c0-6ade-4dcc-9585-b4a2aa49bbb7 req-e3b01462-b01b-404a-8187-57f8248f7407 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:15.956855 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-2cefe9c0-6ade-4dcc-9585-b4a2aa49bbb7 req-e3b01462-b01b-404a-8187-57f8248f7407 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:15.957340 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-2cefe9c0-6ade-4dcc-9585-b4a2aa49bbb7 req-e3b01462-b01b-404a-8187-57f8248f7407 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:15.975154 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-2cefe9c0-6ade-4dcc-9585-b4a2aa49bbb7 req-e3b01462-b01b-404a-8187-57f8248f7407 service nova] Creating event network-changed:dcaa2642-5d4e-4109-91ed-2b174f78eea6 for instance 3051bbe9-8766-4204-9998-a496565cfc22 on hv-cinder-84052 Aug 24 17:53:15.980123 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-2cefe9c0-6ade-4dcc-9585-b4a2aa49bbb7 req-e3b01462-b01b-404a-8187-57f8248f7407 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039802 Aug 24 17:53:15.980716 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 269/563] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:16.388545 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-cb9c4137-5e4e-46c9-80f0-c5414efe5ad2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:16.391007 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-cb9c4137-5e4e-46c9-80f0-c5414efe5ad2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:16.398923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cb9c4137-5e4e-46c9-80f0-c5414efe5ad2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.399628 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cb9c4137-5e4e-46c9-80f0-c5414efe5ad2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.400095 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cb9c4137-5e4e-46c9-80f0-c5414efe5ad2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.400955 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cb9c4137-5e4e-46c9-80f0-c5414efe5ad2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.401436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cb9c4137-5e4e-46c9-80f0-c5414efe5ad2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.401872 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cb9c4137-5e4e-46c9-80f0-c5414efe5ad2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.433499 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-cb9c4137-5e4e-46c9-80f0-c5414efe5ad2 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050291 Aug 24 17:53:16.434395 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 295/564] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:53:16 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:53:16.511465 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d6186993-f811-4cf8-ba95-ebbcc5c996b4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:16.512088 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d6186993-f811-4cf8-ba95-ebbcc5c996b4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:16.518990 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d6186993-f811-4cf8-ba95-ebbcc5c996b4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.519503 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d6186993-f811-4cf8-ba95-ebbcc5c996b4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.519939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d6186993-f811-4cf8-ba95-ebbcc5c996b4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.520658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d6186993-f811-4cf8-ba95-ebbcc5c996b4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.521100 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d6186993-f811-4cf8-ba95-ebbcc5c996b4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.521528 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d6186993-f811-4cf8-ba95-ebbcc5c996b4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d6186993-f811-4cf8-ba95-ebbcc5c996b4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:53:16.559894 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-521bd329-0bf9-46c7-bc03-cb9dc6c45f6a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:16.560715 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-521bd329-0bf9-46c7-bc03-cb9dc6c45f6a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:16.567351 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-521bd329-0bf9-46c7-bc03-cb9dc6c45f6a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.567879 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-521bd329-0bf9-46c7-bc03-cb9dc6c45f6a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.568316 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-521bd329-0bf9-46c7-bc03-cb9dc6c45f6a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.569337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-521bd329-0bf9-46c7-bc03-cb9dc6c45f6a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.569797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-521bd329-0bf9-46c7-bc03-cb9dc6c45f6a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.570397 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-521bd329-0bf9-46c7-bc03-cb9dc6c45f6a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.630860 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d6186993-f811-4cf8-ba95-ebbcc5c996b4 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 204 len: 0 microversion: 2.1 time: 0.123820 Aug 24 17:53:16.631775 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 270/565] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:53:16 2022] DELETE /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:53:16.640591 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-46b59dad-f89b-46ec-ad34-5c1189a8436a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:16.641422 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-46b59dad-f89b-46ec-ad34-5c1189a8436a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:16.648258 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-46b59dad-f89b-46ec-ad34-5c1189a8436a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.649192 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-46b59dad-f89b-46ec-ad34-5c1189a8436a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.649985 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-46b59dad-f89b-46ec-ad34-5c1189a8436a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.651370 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-46b59dad-f89b-46ec-ad34-5c1189a8436a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:16.652332 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-46b59dad-f89b-46ec-ad34-5c1189a8436a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:16.653372 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-46b59dad-f89b-46ec-ad34-5c1189a8436a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:16.723098 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-521bd329-0bf9-46c7-bc03-cb9dc6c45f6a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:16.731236 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-521bd329-0bf9-46c7-bc03-cb9dc6c45f6a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.175349 Aug 24 17:53:16.732137 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 296/566] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:16 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:16.865678 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-46b59dad-f89b-46ec-ad34-5c1189a8436a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:16.873325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-46b59dad-f89b-46ec-ad34-5c1189a8436a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1689 microversion: 2.1 time: 0.237251 Aug 24 17:53:16.873885 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 271/567] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:16 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1689 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:17.751881 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-19eecf41-c380-41e3-86ab-7aec68c82f25 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:17.752487 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-19eecf41-c380-41e3-86ab-7aec68c82f25 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:17.758910 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19eecf41-c380-41e3-86ab-7aec68c82f25 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:17.759383 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19eecf41-c380-41e3-86ab-7aec68c82f25 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:17.759862 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19eecf41-c380-41e3-86ab-7aec68c82f25 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:17.760537 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19eecf41-c380-41e3-86ab-7aec68c82f25 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:17.760987 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19eecf41-c380-41e3-86ab-7aec68c82f25 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:17.761403 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19eecf41-c380-41e3-86ab-7aec68c82f25 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:17.763899 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:17.895729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ba2ec016-dd7c-489e-b27b-e7d563216878 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:17.900986 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ba2ec016-dd7c-489e-b27b-e7d563216878 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:17.905113 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba2ec016-dd7c-489e-b27b-e7d563216878 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:17.907310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba2ec016-dd7c-489e-b27b-e7d563216878 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:17.907310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba2ec016-dd7c-489e-b27b-e7d563216878 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:17.907310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba2ec016-dd7c-489e-b27b-e7d563216878 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:17.907310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba2ec016-dd7c-489e-b27b-e7d563216878 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:17.907724 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ba2ec016-dd7c-489e-b27b-e7d563216878 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:17.929597 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-19eecf41-c380-41e3-86ab-7aec68c82f25 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:17.937177 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-19eecf41-c380-41e3-86ab-7aec68c82f25 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.189193 Aug 24 17:53:17.937746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 297/568] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:17 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:18.036482 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ba2ec016-dd7c-489e-b27b-e7d563216878 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:18.038799 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:18.045925 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ba2ec016-dd7c-489e-b27b-e7d563216878 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1689 microversion: 2.1 time: 0.155088 Aug 24 17:53:18.046485 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 272/569] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:17 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:18.959401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-030caab4-0402-428d-b895-a8523c52e138 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:18.960049 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-030caab4-0402-428d-b895-a8523c52e138 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:18.966009 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-030caab4-0402-428d-b895-a8523c52e138 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:18.966497 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-030caab4-0402-428d-b895-a8523c52e138 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:18.966936 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-030caab4-0402-428d-b895-a8523c52e138 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:18.967670 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-030caab4-0402-428d-b895-a8523c52e138 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:18.968133 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-030caab4-0402-428d-b895-a8523c52e138 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:18.968556 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-030caab4-0402-428d-b895-a8523c52e138 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.069100 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c67b21b0-c442-42d1-8caf-9f26b9203f6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:19.069820 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c67b21b0-c442-42d1-8caf-9f26b9203f6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:19.076937 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c67b21b0-c442-42d1-8caf-9f26b9203f6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.077460 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c67b21b0-c442-42d1-8caf-9f26b9203f6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.077929 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c67b21b0-c442-42d1-8caf-9f26b9203f6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.078624 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c67b21b0-c442-42d1-8caf-9f26b9203f6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:19.079675 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c67b21b0-c442-42d1-8caf-9f26b9203f6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:19.080108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c67b21b0-c442-42d1-8caf-9f26b9203f6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:19.099671 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-030caab4-0402-428d-b895-a8523c52e138 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:19.107271 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-030caab4-0402-428d-b895-a8523c52e138 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.152195 Aug 24 17:53:19.107888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 298/570] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:18 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:19.205409 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c67b21b0-c442-42d1-8caf-9f26b9203f6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:19.213551 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c67b21b0-c442-42d1-8caf-9f26b9203f6a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1689 microversion: 2.1 time: 0.150523 Aug 24 17:53:19.214200 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 273/571] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:19 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:20.127328 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-005c6649-9878-4728-b22c-35d5a1d7bb8d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:20.127891 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-005c6649-9878-4728-b22c-35d5a1d7bb8d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:20.134265 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-005c6649-9878-4728-b22c-35d5a1d7bb8d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:20.134746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-005c6649-9878-4728-b22c-35d5a1d7bb8d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:20.135201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-005c6649-9878-4728-b22c-35d5a1d7bb8d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:20.135905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-005c6649-9878-4728-b22c-35d5a1d7bb8d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:20.136352 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-005c6649-9878-4728-b22c-35d5a1d7bb8d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:20.136816 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-005c6649-9878-4728-b22c-35d5a1d7bb8d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:20.234098 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1e137ce1-b7be-496e-a013-61a8441072cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:20.234705 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1e137ce1-b7be-496e-a013-61a8441072cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:20.241137 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1e137ce1-b7be-496e-a013-61a8441072cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:20.241619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1e137ce1-b7be-496e-a013-61a8441072cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:20.242051 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1e137ce1-b7be-496e-a013-61a8441072cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:20.242746 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1e137ce1-b7be-496e-a013-61a8441072cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:20.243199 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1e137ce1-b7be-496e-a013-61a8441072cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:20.243649 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1e137ce1-b7be-496e-a013-61a8441072cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:20.263754 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-005c6649-9878-4728-b22c-35d5a1d7bb8d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:20.271832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-005c6649-9878-4728-b22c-35d5a1d7bb8d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.148531 Aug 24 17:53:20.272420 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 299/572] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:20 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:20.373695 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1e137ce1-b7be-496e-a013-61a8441072cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:20.381922 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1e137ce1-b7be-496e-a013-61a8441072cf tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1689 microversion: 2.1 time: 0.151646 Aug 24 17:53:20.382425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 274/573] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:20 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:21.293353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c2543a1f-ae5e-453e-89ad-6fb862f02ff1 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:21.293967 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c2543a1f-ae5e-453e-89ad-6fb862f02ff1 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:21.299949 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c2543a1f-ae5e-453e-89ad-6fb862f02ff1 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:21.300435 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c2543a1f-ae5e-453e-89ad-6fb862f02ff1 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:21.300873 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c2543a1f-ae5e-453e-89ad-6fb862f02ff1 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.301565 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c2543a1f-ae5e-453e-89ad-6fb862f02ff1 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:21.302017 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c2543a1f-ae5e-453e-89ad-6fb862f02ff1 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:21.302437 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c2543a1f-ae5e-453e-89ad-6fb862f02ff1 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.403635 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ec87cd74-42f6-4f6b-aa8c-b3e0dfafda2c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:21.404401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ec87cd74-42f6-4f6b-aa8c-b3e0dfafda2c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:21.414201 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ec87cd74-42f6-4f6b-aa8c-b3e0dfafda2c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:21.414823 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ec87cd74-42f6-4f6b-aa8c-b3e0dfafda2c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:21.415359 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ec87cd74-42f6-4f6b-aa8c-b3e0dfafda2c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.416185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ec87cd74-42f6-4f6b-aa8c-b3e0dfafda2c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:21.416790 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ec87cd74-42f6-4f6b-aa8c-b3e0dfafda2c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:21.417621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ec87cd74-42f6-4f6b-aa8c-b3e0dfafda2c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:21.439279 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c2543a1f-ae5e-453e-89ad-6fb862f02ff1 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:21.447729 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c2543a1f-ae5e-453e-89ad-6fb862f02ff1 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.158762 Aug 24 17:53:21.448546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 300/574] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:21 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:21.695500 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ec87cd74-42f6-4f6b-aa8c-b3e0dfafda2c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:21.703259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ec87cd74-42f6-4f6b-aa8c-b3e0dfafda2c tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1689 microversion: 2.1 time: 0.303845 Aug 24 17:53:21.703911 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 275/575] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:21 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1689 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:22.328241 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-b54b7ae3-79c4-461b-8133-7e1f88d66d15 req-2b018aa7-2b07-4fa4-b38e-8d020bcac891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef24bd4c-630a-428f-9eb7-50c5009e9fe1", "name": "network-vif-deleted", "tag": "22d0b6c6-ad45-4659-a4f0-1d8f89c1671d"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:22.340369 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-b54b7ae3-79c4-461b-8133-7e1f88d66d15 req-2b018aa7-2b07-4fa4-b38e-8d020bcac891 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.340846 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-b54b7ae3-79c4-461b-8133-7e1f88d66d15 req-2b018aa7-2b07-4fa4-b38e-8d020bcac891 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.341267 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-b54b7ae3-79c4-461b-8133-7e1f88d66d15 req-2b018aa7-2b07-4fa4-b38e-8d020bcac891 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.353526 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-b54b7ae3-79c4-461b-8133-7e1f88d66d15 req-2b018aa7-2b07-4fa4-b38e-8d020bcac891 service nova] Creating event network-vif-deleted:22d0b6c6-ad45-4659-a4f0-1d8f89c1671d for instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 on hv-cinder-84052 Aug 24 17:53:22.359103 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-b54b7ae3-79c4-461b-8133-7e1f88d66d15 req-2b018aa7-2b07-4fa4-b38e-8d020bcac891 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034969 Aug 24 17:53:22.359727 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 301/576] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:22.469331 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-cd8b6599-e1d1-4753-9058-1a50464c5ea7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:22.470554 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-cd8b6599-e1d1-4753-9058-1a50464c5ea7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:22.477172 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cd8b6599-e1d1-4753-9058-1a50464c5ea7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.477659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cd8b6599-e1d1-4753-9058-1a50464c5ea7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.478096 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cd8b6599-e1d1-4753-9058-1a50464c5ea7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.478801 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cd8b6599-e1d1-4753-9058-1a50464c5ea7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.479257 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cd8b6599-e1d1-4753-9058-1a50464c5ea7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.479897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cd8b6599-e1d1-4753-9058-1a50464c5ea7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.610251 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-cd8b6599-e1d1-4753-9058-1a50464c5ea7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:22.617982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-cd8b6599-e1d1-4753-9058-1a50464c5ea7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.152565 Aug 24 17:53:22.618562 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 276/577] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:22 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:22.728470 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:22.729417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:22.737284 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.737828 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.738766 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.739803 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.740252 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.741032 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.773548 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:22.774037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:22.774473 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:22.774920 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.objects.instance [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lazy-loading 'fault' on Instance uuid ef24bd4c-630a-428f-9eb7-50c5009e9fe1 {{(pid=126994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:22.828437 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:22.837205 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-51a49f59-4af6-4306-9e1b-635617ae04e3 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 200 len: 1334 microversion: 2.1 time: 0.114864 Aug 24 17:53:22.837984 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 302/578] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:22 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 1334 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:23.638143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-741f3994-5456-4dab-a3e6-a4af9c3b71ad tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:23.638791 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-741f3994-5456-4dab-a3e6-a4af9c3b71ad tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:23.645803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-741f3994-5456-4dab-a3e6-a4af9c3b71ad tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.646286 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-741f3994-5456-4dab-a3e6-a4af9c3b71ad tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.646729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-741f3994-5456-4dab-a3e6-a4af9c3b71ad tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:23.647417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-741f3994-5456-4dab-a3e6-a4af9c3b71ad tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.647917 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-741f3994-5456-4dab-a3e6-a4af9c3b71ad tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.648339 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-741f3994-5456-4dab-a3e6-a4af9c3b71ad tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:23.776803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-741f3994-5456-4dab-a3e6-a4af9c3b71ad tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:23.784513 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-741f3994-5456-4dab-a3e6-a4af9c3b71ad tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.150274 Aug 24 17:53:23.785091 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 277/579] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:23 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:23.858219 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d78c4c8c-f383-40cf-bb86-6aa135cb2c03 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:23.858856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d78c4c8c-f383-40cf-bb86-6aa135cb2c03 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: ef24bd4c-630a-428f-9eb7-50c5009e9fe1] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:23.865820 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d78c4c8c-f383-40cf-bb86-6aa135cb2c03 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.866528 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d78c4c8c-f383-40cf-bb86-6aa135cb2c03 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.866972 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d78c4c8c-f383-40cf-bb86-6aa135cb2c03 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:23.867835 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d78c4c8c-f383-40cf-bb86-6aa135cb2c03 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:23.868153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d78c4c8c-f383-40cf-bb86-6aa135cb2c03 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:23.868582 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d78c4c8c-f383-40cf-bb86-6aa135cb2c03 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:23.882710 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-d78c4c8c-f383-40cf-bb86-6aa135cb2c03 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] HTTP exception thrown: Instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 could not be found. Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d78c4c8c-f383-40cf-bb86-6aa135cb2c03 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Request method failure captured: Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 HTTP/1.1 Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmRXXSo9jllcBh3muzG85q1balMF-atjt1OIcAyxcjw16hc-GKcl2STFaNuxKTBDjXoLg9uWGhPWb1tYXoxnNn1OLjyOjPO8b_l3i-5sX-s3w4NWOcztytI1Id99vRg8qfxhsCxnCb1ylUJJIWsQ8B0GF2Xv2njFbtGFkpHPXQPeznc Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 0fb78a439e20439f8d93a4f7df3f28f8 Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:53:23.884401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:53:23.886012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fb78a439e20439f8d93a4f7df3f28f8"}]}] Aug 24 17:53:23.886012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:53:23.886012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 0fb78a439e20439f8d93a4f7df3f28f8 Aug 24 17:53:23.886012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:53:23.886012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-ServerRescueNegativeTestJSON-1642173346-project Aug 24 17:53:23.886012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:53:23.886012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:53:23.886012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 7d3139d9e58f4b56a370661e2a5d4e5e Aug 24 17:53:23.886012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1642173346-project Aug 24 17:53:23.886012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:53:23.886012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 could not be found. Aug 24 17:53:23.886012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': 'ef24bd4c-630a-428f-9eb7-50c5009e9fe1'} Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 could not be found. Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:53:23.886850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 could not be found. Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 could not be found. Aug 24 17:53:23.888193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:53:23.889590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d78c4c8c-f383-40cf-bb86-6aa135cb2c03 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Returning 404 to user: Instance ef24bd4c-630a-428f-9eb7-50c5009e9fe1 could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:53:23.889590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d78c4c8c-f383-40cf-bb86-6aa135cb2c03 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1" status: 404 len: 111 microversion: 2.1 time: 0.031455 Aug 24 17:53:23.889590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 303/580] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:23 2022] GET /compute/v2.1/servers/ef24bd4c-630a-428f-9eb7-50c5009e9fe1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:53:23.894669 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a1d7fbd2-d537-4f98-bff6-c510da65a2ae tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '.version_select at 0x7f4b29836670>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:23.914550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a1d7fbd2-d537-4f98-bff6-c510da65a2ae tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-529029050" status: 202 len: 0 microversion: 2.1 time: 0.023911 Aug 24 17:53:23.915125 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 278/581] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Aug 24 17:53:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-529029050 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:53:24.805002 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5479e0d3-a0b3-436c-afd3-21f78cfdc9b4 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:24.805613 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5479e0d3-a0b3-436c-afd3-21f78cfdc9b4 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:24.811471 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5479e0d3-a0b3-436c-afd3-21f78cfdc9b4 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:24.811976 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5479e0d3-a0b3-436c-afd3-21f78cfdc9b4 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:24.812402 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5479e0d3-a0b3-436c-afd3-21f78cfdc9b4 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:24.813079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5479e0d3-a0b3-436c-afd3-21f78cfdc9b4 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:24.813529 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5479e0d3-a0b3-436c-afd3-21f78cfdc9b4 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:24.813973 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5479e0d3-a0b3-436c-afd3-21f78cfdc9b4 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:24.941800 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5479e0d3-a0b3-436c-afd3-21f78cfdc9b4 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:24.949439 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5479e0d3-a0b3-436c-afd3-21f78cfdc9b4 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.148356 Aug 24 17:53:24.950002 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 304/582] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:24 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:25.304259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-36fce551-d054-49bb-b371-6ed97b0d2b29 req-fbcd0f02-b1a5-4f92-8620-af82162a1ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3051bbe9-8766-4204-9998-a496565cfc22", "name": "network-vif-plugged", "status": "completed", "tag": "dcaa2642-5d4e-4109-91ed-2b174f78eea6"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:25.316114 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-36fce551-d054-49bb-b371-6ed97b0d2b29 req-fbcd0f02-b1a5-4f92-8620-af82162a1ae9 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.316598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-36fce551-d054-49bb-b371-6ed97b0d2b29 req-fbcd0f02-b1a5-4f92-8620-af82162a1ae9 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.317021 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-36fce551-d054-49bb-b371-6ed97b0d2b29 req-fbcd0f02-b1a5-4f92-8620-af82162a1ae9 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.327516 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-36fce551-d054-49bb-b371-6ed97b0d2b29 req-fbcd0f02-b1a5-4f92-8620-af82162a1ae9 service nova] Creating event network-vif-plugged:dcaa2642-5d4e-4109-91ed-2b174f78eea6 for instance 3051bbe9-8766-4204-9998-a496565cfc22 on hv-cinder-84052 Aug 24 17:53:25.333231 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-36fce551-d054-49bb-b371-6ed97b0d2b29 req-fbcd0f02-b1a5-4f92-8620-af82162a1ae9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032911 Aug 24 17:53:25.334033 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 279/583] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:25.970754 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0a3ea333-01cc-4c2d-8e52-187e2f44d5ef tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:25.971394 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0a3ea333-01cc-4c2d-8e52-187e2f44d5ef tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:25.977832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0a3ea333-01cc-4c2d-8e52-187e2f44d5ef tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.978310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0a3ea333-01cc-4c2d-8e52-187e2f44d5ef tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.978740 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0a3ea333-01cc-4c2d-8e52-187e2f44d5ef tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:25.979413 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0a3ea333-01cc-4c2d-8e52-187e2f44d5ef tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:25.979886 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0a3ea333-01cc-4c2d-8e52-187e2f44d5ef tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:25.980303 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0a3ea333-01cc-4c2d-8e52-187e2f44d5ef tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:26.110691 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0a3ea333-01cc-4c2d-8e52-187e2f44d5ef tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:26.118592 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0a3ea333-01cc-4c2d-8e52-187e2f44d5ef tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1358 microversion: 2.1 time: 0.152333 Aug 24 17:53:26.119149 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 305/584] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:25 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:26.771919 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-fa1a74b8-9419-4095-9b40-d169563bead9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:26.772562 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-fa1a74b8-9419-4095-9b40-d169563bead9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:26.778531 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fa1a74b8-9419-4095-9b40-d169563bead9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:26.779001 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fa1a74b8-9419-4095-9b40-d169563bead9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:26.779426 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fa1a74b8-9419-4095-9b40-d169563bead9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:26.780127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fa1a74b8-9419-4095-9b40-d169563bead9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:26.780574 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fa1a74b8-9419-4095-9b40-d169563bead9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:26.780990 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fa1a74b8-9419-4095-9b40-d169563bead9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:26.805079 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-fa1a74b8-9419-4095-9b40-d169563bead9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:53:26.876984 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-fa1a74b8-9419-4095-9b40-d169563bead9 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 204 len: 0 microversion: 2.1 time: 0.109690 Aug 24 17:53:26.877554 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 280/585] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:53:26 2022] DELETE /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:53:26.885713 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3ee9c3be-3823-4b05-9183-3e0bd0de0f83 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:26.886468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3ee9c3be-3823-4b05-9183-3e0bd0de0f83 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:26.892891 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ee9c3be-3823-4b05-9183-3e0bd0de0f83 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:26.893378 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ee9c3be-3823-4b05-9183-3e0bd0de0f83 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:26.893820 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ee9c3be-3823-4b05-9183-3e0bd0de0f83 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:26.894513 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ee9c3be-3823-4b05-9183-3e0bd0de0f83 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:26.894974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ee9c3be-3823-4b05-9183-3e0bd0de0f83 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:26.895401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ee9c3be-3823-4b05-9183-3e0bd0de0f83 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.026996 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3ee9c3be-3823-4b05-9183-3e0bd0de0f83 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:27.035499 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3ee9c3be-3823-4b05-9183-3e0bd0de0f83 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1506 microversion: 2.1 time: 0.153618 Aug 24 17:53:27.036101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 306/586] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:26 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:27.138832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-160f28be-d099-4cf6-a4c8-2909a7466c0a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:27.139556 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-160f28be-d099-4cf6-a4c8-2909a7466c0a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:27.146181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-160f28be-d099-4cf6-a4c8-2909a7466c0a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.146702 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-160f28be-d099-4cf6-a4c8-2909a7466c0a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.147138 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-160f28be-d099-4cf6-a4c8-2909a7466c0a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.147867 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-160f28be-d099-4cf6-a4c8-2909a7466c0a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.148324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-160f28be-d099-4cf6-a4c8-2909a7466c0a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.148747 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-160f28be-d099-4cf6-a4c8-2909a7466c0a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.278914 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-160f28be-d099-4cf6-a4c8-2909a7466c0a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:27.286616 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-160f28be-d099-4cf6-a4c8-2909a7466c0a tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1547 microversion: 2.1 time: 0.152132 Aug 24 17:53:27.287177 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 281/587] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:27 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:27.306375 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6a457083-438a-4d65-bbb2-43e7c13ecc96 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:27.306991 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-6a457083-438a-4d65-bbb2-43e7c13ecc96 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:27.313449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6a457083-438a-4d65-bbb2-43e7c13ecc96 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.313938 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6a457083-438a-4d65-bbb2-43e7c13ecc96 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.314404 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6a457083-438a-4d65-bbb2-43e7c13ecc96 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.315089 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6a457083-438a-4d65-bbb2-43e7c13ecc96 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.315580 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6a457083-438a-4d65-bbb2-43e7c13ecc96 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.316033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6a457083-438a-4d65-bbb2-43e7c13ecc96 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.444525 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6a457083-438a-4d65-bbb2-43e7c13ecc96 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:27.452176 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6a457083-438a-4d65-bbb2-43e7c13ecc96 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1547 microversion: 2.1 time: 0.149609 Aug 24 17:53:27.452738 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 307/588] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:27 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:27.472123 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4bb6af83-0b2e-4eb0-a534-207eb0305fca tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:27.476757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4bb6af83-0b2e-4eb0-a534-207eb0305fca tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:27.477515 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4bb6af83-0b2e-4eb0-a534-207eb0305fca tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Searching by: {'deleted': False, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9'} {{(pid=126993) get_all /opt/stack/nova/nova/compute/api.py:3015}} Aug 24 17:53:27.483996 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4bb6af83-0b2e-4eb0-a534-207eb0305fca tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.484471 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4bb6af83-0b2e-4eb0-a534-207eb0305fca tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.485397 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4bb6af83-0b2e-4eb0-a534-207eb0305fca tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.486112 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4bb6af83-0b2e-4eb0-a534-207eb0305fca tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.486562 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4bb6af83-0b2e-4eb0-a534-207eb0305fca tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.486981 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4bb6af83-0b2e-4eb0-a534-207eb0305fca tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.574165 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.multi_cell_list [None req-4bb6af83-0b2e-4eb0-a534-207eb0305fca tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 17:53:27.666596 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4bb6af83-0b2e-4eb0-a534-207eb0305fca tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198311 Aug 24 17:53:27.667179 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 282/589] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Aug 24 17:53:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:27.678726 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a0cc05c6-b9e5-4ae0-ab85-7e88f1c17e01 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:27.679336 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a0cc05c6-b9e5-4ae0-ab85-7e88f1c17e01 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:27.685209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a0cc05c6-b9e5-4ae0-ab85-7e88f1c17e01 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.685685 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a0cc05c6-b9e5-4ae0-ab85-7e88f1c17e01 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.686120 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a0cc05c6-b9e5-4ae0-ab85-7e88f1c17e01 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.686795 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a0cc05c6-b9e5-4ae0-ab85-7e88f1c17e01 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:27.687243 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a0cc05c6-b9e5-4ae0-ab85-7e88f1c17e01 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:27.687691 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a0cc05c6-b9e5-4ae0-ab85-7e88f1c17e01 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:27.814225 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a0cc05c6-b9e5-4ae0-ab85-7e88f1c17e01 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:27.821885 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a0cc05c6-b9e5-4ae0-ab85-7e88f1c17e01 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1547 microversion: 2.1 time: 0.146950 Aug 24 17:53:27.822453 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 308/590] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:27 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:28.057567 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e58cb579-994e-41fc-99d0-b5d904efff9d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:28.058263 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e58cb579-994e-41fc-99d0-b5d904efff9d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:28.069816 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e58cb579-994e-41fc-99d0-b5d904efff9d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.069816 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e58cb579-994e-41fc-99d0-b5d904efff9d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.069816 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e58cb579-994e-41fc-99d0-b5d904efff9d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:28.069816 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e58cb579-994e-41fc-99d0-b5d904efff9d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:28.071312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e58cb579-994e-41fc-99d0-b5d904efff9d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:28.071312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e58cb579-994e-41fc-99d0-b5d904efff9d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:28.202611 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e58cb579-994e-41fc-99d0-b5d904efff9d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:28.211171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e58cb579-994e-41fc-99d0-b5d904efff9d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1506 microversion: 2.1 time: 0.158435 Aug 24 17:53:28.211757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 283/591] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:28 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:29.232341 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ca39aa02-17d5-4460-b877-23b2c765df7d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:29.233011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ca39aa02-17d5-4460-b877-23b2c765df7d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:29.239784 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca39aa02-17d5-4460-b877-23b2c765df7d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.240286 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca39aa02-17d5-4460-b877-23b2c765df7d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.240723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca39aa02-17d5-4460-b877-23b2c765df7d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.241419 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca39aa02-17d5-4460-b877-23b2c765df7d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.241874 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca39aa02-17d5-4460-b877-23b2c765df7d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.242297 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca39aa02-17d5-4460-b877-23b2c765df7d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.362821 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5f0d4f51-575b-47ea-b304-503f452b2ade tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "369824ae-072e-43a2-b1e0-19f0528a71fe"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:29.366399 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5f0d4f51-575b-47ea-b304-503f452b2ade tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:29.373377 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ca39aa02-17d5-4460-b877-23b2c765df7d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:29.380422 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5f0d4f51-575b-47ea-b304-503f452b2ade tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.381032 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5f0d4f51-575b-47ea-b304-503f452b2ade tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.381474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5f0d4f51-575b-47ea-b304-503f452b2ade tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.382178 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5f0d4f51-575b-47ea-b304-503f452b2ade tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.382663 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5f0d4f51-575b-47ea-b304-503f452b2ade tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.383089 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5f0d4f51-575b-47ea-b304-503f452b2ade tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.383762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ca39aa02-17d5-4460-b877-23b2c765df7d tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 200 len: 1506 microversion: 2.1 time: 0.155180 Aug 24 17:53:29.384447 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 309/592] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:29 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:29.643310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5f0d4f51-575b-47ea-b304-503f452b2ade tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "POST /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284455 Aug 24 17:53:29.644063 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 284/593] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:53:29 2022] POST /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:29.928274 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-acbc473b-5200-476e-92c2-2e808f9bbe52 req-5f37455a-975a-459d-89ec-06a78b913c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa644603-71e5-4474-ac86-f0f7ce938d0f", "name": "network-vif-deleted", "tag": "739a8b43-ab7a-4d3c-b2a6-c214a877b1e1"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:29.938489 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-acbc473b-5200-476e-92c2-2e808f9bbe52 req-5f37455a-975a-459d-89ec-06a78b913c04 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:29.939271 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-acbc473b-5200-476e-92c2-2e808f9bbe52 req-5f37455a-975a-459d-89ec-06a78b913c04 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:29.939731 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-acbc473b-5200-476e-92c2-2e808f9bbe52 req-5f37455a-975a-459d-89ec-06a78b913c04 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:29.953837 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-acbc473b-5200-476e-92c2-2e808f9bbe52 req-5f37455a-975a-459d-89ec-06a78b913c04 service nova] Creating event network-vif-deleted:739a8b43-ab7a-4d3c-b2a6-c214a877b1e1 for instance aa644603-71e5-4474-ac86-f0f7ce938d0f on hv-cinder-84052 Aug 24 17:53:29.959499 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-acbc473b-5200-476e-92c2-2e808f9bbe52 req-5f37455a-975a-459d-89ec-06a78b913c04 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105960 Aug 24 17:53:29.960103 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 310/594] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:30.407316 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-12ff31e2-9b7d-407d-9e50-341c8d1abd9a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:30.408000 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-12ff31e2-9b7d-407d-9e50-341c8d1abd9a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: aa644603-71e5-4474-ac86-f0f7ce938d0f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:30.414105 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-12ff31e2-9b7d-407d-9e50-341c8d1abd9a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.414593 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-12ff31e2-9b7d-407d-9e50-341c8d1abd9a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.415033 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-12ff31e2-9b7d-407d-9e50-341c8d1abd9a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.415754 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-12ff31e2-9b7d-407d-9e50-341c8d1abd9a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.416215 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-12ff31e2-9b7d-407d-9e50-341c8d1abd9a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.416642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-12ff31e2-9b7d-407d-9e50-341c8d1abd9a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.430599 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-12ff31e2-9b7d-407d-9e50-341c8d1abd9a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] HTTP exception thrown: Instance aa644603-71e5-4474-ac86-f0f7ce938d0f could not be found. Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-12ff31e2-9b7d-407d-9e50-341c8d1abd9a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Request method failure captured: Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f HTTP/1.1 Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmRXXSo9jllcBh3muzG85q1balMF-atjt1OIcAyxcjw16hc-GKcl2STFaNuxKTBDjXoLg9uWGhPWb1tYXoxnNn1OLjyOjPO8b_l3i-5sX-s3w4NWOcztytI1Id99vRg8qfxhsCxnCb1ylUJJIWsQ8B0GF2Xv2njFbtGFkpHPXQPeznc Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 0fb78a439e20439f8d93a4f7df3f28f8 Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:53:30.432181 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:53:30.433704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fb78a439e20439f8d93a4f7df3f28f8"}]}] Aug 24 17:53:30.433704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:53:30.433704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 0fb78a439e20439f8d93a4f7df3f28f8 Aug 24 17:53:30.433704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:53:30.433704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-ServerRescueNegativeTestJSON-1642173346-project Aug 24 17:53:30.433704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:53:30.433704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:53:30.433704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 7d3139d9e58f4b56a370661e2a5d4e5e Aug 24 17:53:30.433704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1642173346-project Aug 24 17:53:30.433704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:53:30.433704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance aa644603-71e5-4474-ac86-f0f7ce938d0f could not be found. Aug 24 17:53:30.433704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': 'aa644603-71e5-4474-ac86-f0f7ce938d0f'} Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa644603-71e5-4474-ac86-f0f7ce938d0f could not be found. Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:53:30.434626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa644603-71e5-4474-ac86-f0f7ce938d0f could not be found. Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa644603-71e5-4474-ac86-f0f7ce938d0f could not be found. Aug 24 17:53:30.436117 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:53:30.437482 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-12ff31e2-9b7d-407d-9e50-341c8d1abd9a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Returning 404 to user: Instance aa644603-71e5-4474-ac86-f0f7ce938d0f could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:53:30.437482 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-12ff31e2-9b7d-407d-9e50-341c8d1abd9a tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f" status: 404 len: 111 microversion: 2.1 time: 0.032326 Aug 24 17:53:30.437482 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 285/595] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:30 2022] GET /compute/v2.1/servers/aa644603-71e5-4474-ac86-f0f7ce938d0f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:53:30.443954 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-13dac182-911e-4a9e-8108-8c6f56267125 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:30.444558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-13dac182-911e-4a9e-8108-8c6f56267125 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:30.450567 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-13dac182-911e-4a9e-8108-8c6f56267125 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.451042 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-13dac182-911e-4a9e-8108-8c6f56267125 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.451498 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-13dac182-911e-4a9e-8108-8c6f56267125 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.452171 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-13dac182-911e-4a9e-8108-8c6f56267125 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.452627 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-13dac182-911e-4a9e-8108-8c6f56267125 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.453041 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-13dac182-911e-4a9e-8108-8c6f56267125 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.477820 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-13dac182-911e-4a9e-8108-8c6f56267125 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Going to try to terminate instance {{(pid=126994) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:53:30.552798 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-13dac182-911e-4a9e-8108-8c6f56267125 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 204 len: 0 microversion: 2.1 time: 0.113310 Aug 24 17:53:30.553484 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 311/596] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:53:30 2022] DELETE /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:53:30.561661 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-18d0cd21-ec28-44e2-82bf-39a6df38f8ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:30.562271 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-18d0cd21-ec28-44e2-82bf-39a6df38f8ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:30.569292 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-18d0cd21-ec28-44e2-82bf-39a6df38f8ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.569829 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-18d0cd21-ec28-44e2-82bf-39a6df38f8ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.570310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-18d0cd21-ec28-44e2-82bf-39a6df38f8ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.571016 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-18d0cd21-ec28-44e2-82bf-39a6df38f8ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:30.571517 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-18d0cd21-ec28-44e2-82bf-39a6df38f8ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:30.571939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-18d0cd21-ec28-44e2-82bf-39a6df38f8ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:30.701410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-18d0cd21-ec28-44e2-82bf-39a6df38f8ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:30.709710 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-18d0cd21-ec28-44e2-82bf-39a6df38f8ba tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.151969 Aug 24 17:53:30.710277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 286/597] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:30 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:31.730392 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-02ceb337-3d8d-4d11-a1a6-dd5890687764 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:31.731103 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-02ceb337-3d8d-4d11-a1a6-dd5890687764 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:31.738136 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-02ceb337-3d8d-4d11-a1a6-dd5890687764 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:31.738624 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-02ceb337-3d8d-4d11-a1a6-dd5890687764 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:31.739061 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-02ceb337-3d8d-4d11-a1a6-dd5890687764 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:31.739781 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-02ceb337-3d8d-4d11-a1a6-dd5890687764 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:31.740241 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-02ceb337-3d8d-4d11-a1a6-dd5890687764 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:31.740668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-02ceb337-3d8d-4d11-a1a6-dd5890687764 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:31.872726 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-02ceb337-3d8d-4d11-a1a6-dd5890687764 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:31.880453 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-02ceb337-3d8d-4d11-a1a6-dd5890687764 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.154338 Aug 24 17:53:31.881019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 312/598] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:31 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:32.901028 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d08f6426-fdbc-47c5-85db-e01678b4fe99 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:32.901640 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d08f6426-fdbc-47c5-85db-e01678b4fe99 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:32.908667 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d08f6426-fdbc-47c5-85db-e01678b4fe99 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.909144 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d08f6426-fdbc-47c5-85db-e01678b4fe99 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.909573 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d08f6426-fdbc-47c5-85db-e01678b4fe99 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:32.910254 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d08f6426-fdbc-47c5-85db-e01678b4fe99 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:32.910701 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d08f6426-fdbc-47c5-85db-e01678b4fe99 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:32.911116 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d08f6426-fdbc-47c5-85db-e01678b4fe99 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:33.043740 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d08f6426-fdbc-47c5-85db-e01678b4fe99 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:33.051346 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d08f6426-fdbc-47c5-85db-e01678b4fe99 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1522 microversion: 2.1 time: 0.154075 Aug 24 17:53:33.051931 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 287/599] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:32 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:34.073761 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-cfd5ee96-9f59-44a6-8741-b9047f572624 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:34.074602 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-cfd5ee96-9f59-44a6-8741-b9047f572624 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:34.081605 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cfd5ee96-9f59-44a6-8741-b9047f572624 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:34.082099 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cfd5ee96-9f59-44a6-8741-b9047f572624 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:34.082976 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cfd5ee96-9f59-44a6-8741-b9047f572624 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:34.083899 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cfd5ee96-9f59-44a6-8741-b9047f572624 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:34.084366 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cfd5ee96-9f59-44a6-8741-b9047f572624 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:34.084794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cfd5ee96-9f59-44a6-8741-b9047f572624 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:34.141925 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-e9907cfa-43df-4df5-90b3-058d4b67f593 req-be6ccf95-67fd-4ee2-9d4b-0003c98e6b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0397fbeb-25d8-46af-98bb-8a7b70c97f48", "name": "network-vif-deleted", "tag": "87b079d0-f5b8-4315-b27a-8988f8c98b86"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:34.159718 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-e9907cfa-43df-4df5-90b3-058d4b67f593 req-be6ccf95-67fd-4ee2-9d4b-0003c98e6b93 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:34.160200 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-e9907cfa-43df-4df5-90b3-058d4b67f593 req-be6ccf95-67fd-4ee2-9d4b-0003c98e6b93 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:34.160622 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-e9907cfa-43df-4df5-90b3-058d4b67f593 req-be6ccf95-67fd-4ee2-9d4b-0003c98e6b93 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:34.164269 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-cfd5ee96-9f59-44a6-8741-b9047f572624 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3139d9e58f4b56a370661e2a5d4e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb78a439e20439f8d93a4f7df3f28f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:34.166618 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:34.173546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-cfd5ee96-9f59-44a6-8741-b9047f572624 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 200 len: 1480 microversion: 2.1 time: 0.103675 Aug 24 17:53:34.174129 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 313/600] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:34 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 1480 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:34.176137 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-e9907cfa-43df-4df5-90b3-058d4b67f593 req-be6ccf95-67fd-4ee2-9d4b-0003c98e6b93 service nova] Creating event network-vif-deleted:87b079d0-f5b8-4315-b27a-8988f8c98b86 for instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 on hv-cinder-84052 Aug 24 17:53:34.181527 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-e9907cfa-43df-4df5-90b3-058d4b67f593 req-be6ccf95-67fd-4ee2-9d4b-0003c98e6b93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044600 Aug 24 17:53:34.182312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 288/601] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:35.194333 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-450084f2-c110-4172-87cb-c363e8ee3623 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:35.194854 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-450084f2-c110-4172-87cb-c363e8ee3623 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] [instance: 0397fbeb-25d8-46af-98bb-8a7b70c97f48] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:35.202608 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-450084f2-c110-4172-87cb-c363e8ee3623 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:35.203089 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-450084f2-c110-4172-87cb-c363e8ee3623 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:35.204067 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-450084f2-c110-4172-87cb-c363e8ee3623 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:35.204746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-450084f2-c110-4172-87cb-c363e8ee3623 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:35.205197 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-450084f2-c110-4172-87cb-c363e8ee3623 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:35.205618 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-450084f2-c110-4172-87cb-c363e8ee3623 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:35.220007 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-450084f2-c110-4172-87cb-c363e8ee3623 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] HTTP exception thrown: Instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 could not be found. Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-450084f2-c110-4172-87cb-c363e8ee3623 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Request method failure captured: Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 HTTP/1.1 Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmRXXSo9jllcBh3muzG85q1balMF-atjt1OIcAyxcjw16hc-GKcl2STFaNuxKTBDjXoLg9uWGhPWb1tYXoxnNn1OLjyOjPO8b_l3i-5sX-s3w4NWOcztytI1Id99vRg8qfxhsCxnCb1ylUJJIWsQ8B0GF2Xv2njFbtGFkpHPXQPeznc Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 0fb78a439e20439f8d93a4f7df3f28f8 Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:53:35.221617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:53:35.223165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0fb78a439e20439f8d93a4f7df3f28f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0fb78a439e20439f8d93a4f7df3f28f8"}]}] Aug 24 17:53:35.223165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:53:35.223165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 0fb78a439e20439f8d93a4f7df3f28f8 Aug 24 17:53:35.223165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1642173346 Aug 24 17:53:35.223165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-ServerRescueNegativeTestJSON-1642173346-project Aug 24 17:53:35.223165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:53:35.223165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:53:35.223165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 7d3139d9e58f4b56a370661e2a5d4e5e Aug 24 17:53:35.223165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1642173346-project Aug 24 17:53:35.223165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:53:35.223165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 could not be found. Aug 24 17:53:35.223165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '0397fbeb-25d8-46af-98bb-8a7b70c97f48'} Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 could not be found. Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:53:35.224218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 could not be found. Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 could not be found. Aug 24 17:53:35.225625 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:53:35.227094 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-450084f2-c110-4172-87cb-c363e8ee3623 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] Returning 404 to user: Instance 0397fbeb-25d8-46af-98bb-8a7b70c97f48 could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:53:35.227094 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-450084f2-c110-4172-87cb-c363e8ee3623 tempest-ServerRescueNegativeTestJSON-1642173346 tempest-ServerRescueNegativeTestJSON-1642173346-project] 10.222.0.27 "GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48" status: 404 len: 111 microversion: 2.1 time: 0.032623 Aug 24 17:53:35.227094 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 314/602] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:35 2022] GET /compute/v2.1/servers/0397fbeb-25d8-46af-98bb-8a7b70c97f48 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:53:37.247049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a4af50d5-fc71-4653-87bf-35fcfbd9f55d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:37.247788 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a4af50d5-fc71-4653-87bf-35fcfbd9f55d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:37.254539 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a4af50d5-fc71-4653-87bf-35fcfbd9f55d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:37.255019 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a4af50d5-fc71-4653-87bf-35fcfbd9f55d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:37.255452 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a4af50d5-fc71-4653-87bf-35fcfbd9f55d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:37.256206 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a4af50d5-fc71-4653-87bf-35fcfbd9f55d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:37.256619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a4af50d5-fc71-4653-87bf-35fcfbd9f55d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:37.257042 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a4af50d5-fc71-4653-87bf-35fcfbd9f55d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:37.261425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:37.465344 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a4af50d5-fc71-4653-87bf-35fcfbd9f55d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:37.474510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a4af50d5-fc71-4653-87bf-35fcfbd9f55d tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1593 microversion: 2.1 time: 0.231564 Aug 24 17:53:37.475084 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 289/603] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:37 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1593 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:39.765868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-ac432827-7ec8-482e-9eb5-6bd4dcddeb6b req-bdba71c5-cbdb-4cd2-ab23-f0c8526c5e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3051bbe9-8766-4204-9998-a496565cfc22", "tag": "dcaa2642-5d4e-4109-91ed-2b174f78eea6"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:39.785661 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ac432827-7ec8-482e-9eb5-6bd4dcddeb6b req-bdba71c5-cbdb-4cd2-ab23-f0c8526c5e1f service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:39.786178 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ac432827-7ec8-482e-9eb5-6bd4dcddeb6b req-bdba71c5-cbdb-4cd2-ab23-f0c8526c5e1f service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:39.786592 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ac432827-7ec8-482e-9eb5-6bd4dcddeb6b req-bdba71c5-cbdb-4cd2-ab23-f0c8526c5e1f service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:39.800075 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-ac432827-7ec8-482e-9eb5-6bd4dcddeb6b req-bdba71c5-cbdb-4cd2-ab23-f0c8526c5e1f service nova] Creating event network-changed:dcaa2642-5d4e-4109-91ed-2b174f78eea6 for instance 3051bbe9-8766-4204-9998-a496565cfc22 on hv-cinder-84052 Aug 24 17:53:39.809756 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-ac432827-7ec8-482e-9eb5-6bd4dcddeb6b req-bdba71c5-cbdb-4cd2-ab23-f0c8526c5e1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243539 Aug 24 17:53:39.810830 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 315/604] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:41.078033 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-37813544-3949-4435-af10-adfe9bf0c49f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1106750636"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:41.078757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-37813544-3949-4435-af10-adfe9bf0c49f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:41.091201 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:41.094891 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-37813544-3949-4435-af10-adfe9bf0c49f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:41.095381 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-37813544-3949-4435-af10-adfe9bf0c49f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:41.099801 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-37813544-3949-4435-af10-adfe9bf0c49f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:41.101700 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-37813544-3949-4435-af10-adfe9bf0c49f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:41.102346 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-37813544-3949-4435-af10-adfe9bf0c49f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:41.102621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-37813544-3949-4435-af10-adfe9bf0c49f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:41.261024 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.network.security_group_api [None req-37813544-3949-4435-af10-adfe9bf0c49f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Adding security group e579ecf1-2400-4e55-ad10-674179e9d30e to port dcaa2642-5d4e-4109-91ed-2b174f78eea6 Aug 24 17:53:41.617855 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-37813544-3949-4435-af10-adfe9bf0c49f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "POST /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/action" status: 202 len: 0 microversion: 2.1 time: 0.545037 Aug 24 17:53:41.618720 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 290/605] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:53:41 2022] POST /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:53:41.628199 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-398d3008-f151-4c98-925f-e71746b9de4f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:41.628992 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-398d3008-f151-4c98-925f-e71746b9de4f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:41.646082 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-398d3008-f151-4c98-925f-e71746b9de4f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:41.646963 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-398d3008-f151-4c98-925f-e71746b9de4f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:41.647888 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-f5845734-97fc-4a2a-89c6-146b0d0650da req-40a625da-2bae-447e-8a13-f0e0fcd0ead4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3051bbe9-8766-4204-9998-a496565cfc22", "tag": "dcaa2642-5d4e-4109-91ed-2b174f78eea6"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:41.659662 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-398d3008-f151-4c98-925f-e71746b9de4f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:41.661182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-398d3008-f151-4c98-925f-e71746b9de4f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:41.663086 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-398d3008-f151-4c98-925f-e71746b9de4f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:41.663789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-398d3008-f151-4c98-925f-e71746b9de4f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:41.670470 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-f5845734-97fc-4a2a-89c6-146b0d0650da req-40a625da-2bae-447e-8a13-f0e0fcd0ead4 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:41.671385 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-f5845734-97fc-4a2a-89c6-146b0d0650da req-40a625da-2bae-447e-8a13-f0e0fcd0ead4 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:41.675550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-f5845734-97fc-4a2a-89c6-146b0d0650da req-40a625da-2bae-447e-8a13-f0e0fcd0ead4 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:41.706793 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-f5845734-97fc-4a2a-89c6-146b0d0650da req-40a625da-2bae-447e-8a13-f0e0fcd0ead4 service nova] Creating event network-changed:dcaa2642-5d4e-4109-91ed-2b174f78eea6 for instance 3051bbe9-8766-4204-9998-a496565cfc22 on hv-cinder-84052 Aug 24 17:53:41.716388 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-f5845734-97fc-4a2a-89c6-146b0d0650da req-40a625da-2bae-447e-8a13-f0e0fcd0ead4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075757 Aug 24 17:53:41.721777 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 291/606] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:42.045747 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-398d3008-f151-4c98-925f-e71746b9de4f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:42.055128 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-398d3008-f151-4c98-925f-e71746b9de4f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1757 microversion: 2.1 time: 0.431682 Aug 24 17:53:42.057222 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 316/607] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:41 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1757 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:43.609586 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-eb82dd80-c340-45f9-bf34-b793ac7e7a0e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:43.610794 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-eb82dd80-c340-45f9-bf34-b793ac7e7a0e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:43.618206 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eb82dd80-c340-45f9-bf34-b793ac7e7a0e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:43.619081 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eb82dd80-c340-45f9-bf34-b793ac7e7a0e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:43.619809 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eb82dd80-c340-45f9-bf34-b793ac7e7a0e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:43.620799 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eb82dd80-c340-45f9-bf34-b793ac7e7a0e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:43.621465 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eb82dd80-c340-45f9-bf34-b793ac7e7a0e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:43.622131 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-eb82dd80-c340-45f9-bf34-b793ac7e7a0e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:43.654425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-eb82dd80-c340-45f9-bf34-b793ac7e7a0e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/ips" status: 200 len: 151 microversion: 2.20 time: 0.273495 Aug 24 17:53:43.655565 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 292/608] 10.222.0.27 () {60 vars in 1289 bytes} [Wed Aug 24 17:53:43 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/ips => generated 151 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:53:44.838678 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8f4d8759-32c5-48f3-baf8-25dd77779266 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: .version_select at 0x7f4b2985b8b0>, body: {"keypair": {"name": "tempest-keypair-1601424484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQhG5JIrDdHvji0DpjBmwvlgQAc+4P57FhFax0F/gjowOIQ2Ul9adGBqhX2BieaqWMAxgWmfkfkvB2mOd06+q4PaCQBcCbX+/V2HyAukL5ivbuqoqIAVIczOP0qF+Y/jg=="}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:44.844851 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:44.859083 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-8f4d8759-32c5-48f3-baf8-25dd77779266 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for project 625652cfa47248faac8c1f7759c56a14. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:53:44.863188 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-8f4d8759-32c5-48f3-baf8-25dd77779266 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for user d8b9d2b042c04927b9115085fcb4ba40 and project 625652cfa47248faac8c1f7759c56a14. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:53:44.898178 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8f4d8759-32c5-48f3-baf8-25dd77779266 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113940 Aug 24 17:53:44.898874 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 317/609] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 17:53:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:46.224856 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-287072783", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87807a97-d368-4c81-a10c-4e62e5ebdb01"}], "security_groups": [{"name": "tempest-securitygroup--1903233216"}], "key_name": "tempest-keypair-1601424484", "user_data": "}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:46.233602 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:46.288306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fbc1c605-0060-4463-a4eb-96715b500352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:46.288839 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-fbc1c605-0060-4463-a4eb-96715b500352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:46.298268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fbc1c605-0060-4463-a4eb-96715b500352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:46.298764 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fbc1c605-0060-4463-a4eb-96715b500352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:46.299201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fbc1c605-0060-4463-a4eb-96715b500352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:46.299944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fbc1c605-0060-4463-a4eb-96715b500352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:46.300404 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fbc1c605-0060-4463-a4eb-96715b500352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:46.300854 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fbc1c605-0060-4463-a4eb-96715b500352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:46.327380 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.objects.instance [None req-fbc1c605-0060-4463-a4eb-96715b500352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lazy-loading 'flavor' on Instance uuid 34147b78-b9f5-4566-8d38-f0ed7ef27e7f {{(pid=126994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:46.337059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] validate_networks() for [('87807a97-d368-4c81-a10c-4e62e5ebdb01', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:53:46.573914 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-fbc1c605-0060-4463-a4eb-96715b500352 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "POST /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/action" status: 202 len: 0 microversion: 2.20 time: 0.290072 Aug 24 17:53:46.574848 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 318/610] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Aug 24 17:53:46 2022] POST /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:53:46.584332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-19286669-e68f-427d-9ed0-33a5f8d7adbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:46.585497 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-19286669-e68f-427d-9ed0-33a5f8d7adbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:46.593576 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19286669-e68f-427d-9ed0-33a5f8d7adbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:46.594310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19286669-e68f-427d-9ed0-33a5f8d7adbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:46.594994 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19286669-e68f-427d-9ed0-33a5f8d7adbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:46.596194 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19286669-e68f-427d-9ed0-33a5f8d7adbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:46.596978 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19286669-e68f-427d-9ed0-33a5f8d7adbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:46.597655 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19286669-e68f-427d-9ed0-33a5f8d7adbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:46.740073 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-19286669-e68f-427d-9ed0-33a5f8d7adbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:46.749057 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-19286669-e68f-427d-9ed0-33a5f8d7adbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:46.751296 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-19286669-e68f-427d-9ed0-33a5f8d7adbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:46.752568 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-19286669-e68f-427d-9ed0-33a5f8d7adbc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.172896 Aug 24 17:53:46.753195 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 319/611] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:46 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:46.800672 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:53:46.801138 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:53:46.801772 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:53:46.802212 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:53:46.802652 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:53:46.812581 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:46.813276 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:46.813885 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:46.814623 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:46.815077 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:46.815706 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:46.833955 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for project 625652cfa47248faac8c1f7759c56a14. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:53:46.837927 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for user d8b9d2b042c04927b9115085fcb4ba40 and project 625652cfa47248faac8c1f7759c56a14. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:53:46.848974 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:53:46.851288 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:53:46.899574 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c114eb05-f30e-4276-a74f-a878f3c37ee1 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.679162 Aug 24 17:53:46.906106 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 293/612] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:53:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:53:46.911191 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-bb49120a-14a8-4613-95b5-ce62cdfe6edb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:46.911837 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-bb49120a-14a8-4613-95b5-ce62cdfe6edb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:46.977044 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bb49120a-14a8-4613-95b5-ce62cdfe6edb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:46.986153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-bb49120a-14a8-4613-95b5-ce62cdfe6edb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1241 microversion: 2.1 time: 0.078732 Aug 24 17:53:46.986845 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 320/613] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:46 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:47.776718 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b8474fee-de24-4f16-829e-3a18baabccdc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:47.777336 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b8474fee-de24-4f16-829e-3a18baabccdc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:47.783986 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8474fee-de24-4f16-829e-3a18baabccdc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:47.784422 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8474fee-de24-4f16-829e-3a18baabccdc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:47.784855 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8474fee-de24-4f16-829e-3a18baabccdc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:47.785550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8474fee-de24-4f16-829e-3a18baabccdc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:47.786008 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8474fee-de24-4f16-829e-3a18baabccdc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:47.786428 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8474fee-de24-4f16-829e-3a18baabccdc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:47.921006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b8474fee-de24-4f16-829e-3a18baabccdc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:47.945864 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b8474fee-de24-4f16-829e-3a18baabccdc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:47.947402 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b8474fee-de24-4f16-829e-3a18baabccdc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:47.948699 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b8474fee-de24-4f16-829e-3a18baabccdc tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.176565 Aug 24 17:53:47.949275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 294/614] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:47 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:48.006910 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a9e40e31-6d0e-43b0-8f8c-789016697965 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:48.007549 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a9e40e31-6d0e-43b0-8f8c-789016697965 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:48.016079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a9e40e31-6d0e-43b0-8f8c-789016697965 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:48.017209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a9e40e31-6d0e-43b0-8f8c-789016697965 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:48.018848 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a9e40e31-6d0e-43b0-8f8c-789016697965 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:48.019874 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a9e40e31-6d0e-43b0-8f8c-789016697965 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:48.020707 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a9e40e31-6d0e-43b0-8f8c-789016697965 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:48.021445 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a9e40e31-6d0e-43b0-8f8c-789016697965 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:48.095732 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a9e40e31-6d0e-43b0-8f8c-789016697965 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:48.105105 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a9e40e31-6d0e-43b0-8f8c-789016697965 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1301 microversion: 2.1 time: 0.102144 Aug 24 17:53:48.106285 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 321/615] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:48 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1301 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:48.972779 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c3671723-d3e2-48ad-920f-a73e2c8faee2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:48.973701 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c3671723-d3e2-48ad-920f-a73e2c8faee2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:48.980830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c3671723-d3e2-48ad-920f-a73e2c8faee2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:48.982064 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c3671723-d3e2-48ad-920f-a73e2c8faee2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:48.982518 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c3671723-d3e2-48ad-920f-a73e2c8faee2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:48.983240 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c3671723-d3e2-48ad-920f-a73e2c8faee2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:48.985081 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c3671723-d3e2-48ad-920f-a73e2c8faee2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:48.985540 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c3671723-d3e2-48ad-920f-a73e2c8faee2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:49.127409 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-445c7b6b-0414-450f-a048-45d2c4f0ddec tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:49.128089 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-445c7b6b-0414-450f-a048-45d2c4f0ddec tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:49.134817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-445c7b6b-0414-450f-a048-45d2c4f0ddec tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:49.135316 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-445c7b6b-0414-450f-a048-45d2c4f0ddec tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:49.135800 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-445c7b6b-0414-450f-a048-45d2c4f0ddec tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:49.136508 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-445c7b6b-0414-450f-a048-45d2c4f0ddec tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:49.136966 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-445c7b6b-0414-450f-a048-45d2c4f0ddec tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:49.137394 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-445c7b6b-0414-450f-a048-45d2c4f0ddec tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:49.212988 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c3671723-d3e2-48ad-920f-a73e2c8faee2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:49.222423 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c3671723-d3e2-48ad-920f-a73e2c8faee2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:49.224302 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c3671723-d3e2-48ad-920f-a73e2c8faee2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:49.225587 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c3671723-d3e2-48ad-920f-a73e2c8faee2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.257551 Aug 24 17:53:49.226250 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 295/616] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:48 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:49.292192 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-445c7b6b-0414-450f-a048-45d2c4f0ddec tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:49.300291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-445c7b6b-0414-450f-a048-45d2c4f0ddec tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1367 microversion: 2.1 time: 0.176947 Aug 24 17:53:49.300887 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 322/617] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:49 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:49.801014 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-78d28eef-f143-464c-a6c7-00543701394b req-8108f1b9-5a93-4abf-b55d-fe2d980f325b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e207e34-6199-4650-9358-5ef1fd30774a", "tag": "8c02114c-93ee-4d8c-9f80-148768e58b93"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:49.813506 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-78d28eef-f143-464c-a6c7-00543701394b req-8108f1b9-5a93-4abf-b55d-fe2d980f325b service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:49.813995 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-78d28eef-f143-464c-a6c7-00543701394b req-8108f1b9-5a93-4abf-b55d-fe2d980f325b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:49.814424 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-78d28eef-f143-464c-a6c7-00543701394b req-8108f1b9-5a93-4abf-b55d-fe2d980f325b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:49.829023 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-78d28eef-f143-464c-a6c7-00543701394b req-8108f1b9-5a93-4abf-b55d-fe2d980f325b service nova] Creating event network-changed:8c02114c-93ee-4d8c-9f80-148768e58b93 for instance 2e207e34-6199-4650-9358-5ef1fd30774a on hv-cinder-84052 Aug 24 17:53:49.835456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-78d28eef-f143-464c-a6c7-00543701394b req-8108f1b9-5a93-4abf-b55d-fe2d980f325b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040064 Aug 24 17:53:49.836340 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 296/618] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:50.251297 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-299465dd-0587-48d8-81f5-027223dab5dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:50.251938 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-299465dd-0587-48d8-81f5-027223dab5dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:50.258357 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-299465dd-0587-48d8-81f5-027223dab5dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:50.258837 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-299465dd-0587-48d8-81f5-027223dab5dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:50.259421 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-299465dd-0587-48d8-81f5-027223dab5dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:50.260133 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-299465dd-0587-48d8-81f5-027223dab5dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:50.260586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-299465dd-0587-48d8-81f5-027223dab5dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:50.261006 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-299465dd-0587-48d8-81f5-027223dab5dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:50.322452 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8dc4fd91-8a3e-4d42-9cca-1cee696cb68f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:50.323153 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8dc4fd91-8a3e-4d42-9cca-1cee696cb68f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:50.329820 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8dc4fd91-8a3e-4d42-9cca-1cee696cb68f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:50.330307 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8dc4fd91-8a3e-4d42-9cca-1cee696cb68f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:50.330744 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8dc4fd91-8a3e-4d42-9cca-1cee696cb68f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:50.331439 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8dc4fd91-8a3e-4d42-9cca-1cee696cb68f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:50.332188 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8dc4fd91-8a3e-4d42-9cca-1cee696cb68f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:50.332613 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8dc4fd91-8a3e-4d42-9cca-1cee696cb68f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:50.396090 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-299465dd-0587-48d8-81f5-027223dab5dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:50.404392 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-299465dd-0587-48d8-81f5-027223dab5dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:50.406559 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-299465dd-0587-48d8-81f5-027223dab5dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:50.407752 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-299465dd-0587-48d8-81f5-027223dab5dd tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.161210 Aug 24 17:53:50.408313 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 323/619] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:50 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:50.463980 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8dc4fd91-8a3e-4d42-9cca-1cee696cb68f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:50.472171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8dc4fd91-8a3e-4d42-9cca-1cee696cb68f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1367 microversion: 2.1 time: 0.153982 Aug 24 17:53:50.472728 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 297/620] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:50 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:51.430209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-09d3943c-c9b1-4ee8-be54-3d93145b2f09 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:51.430820 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-09d3943c-c9b1-4ee8-be54-3d93145b2f09 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:51.437190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-09d3943c-c9b1-4ee8-be54-3d93145b2f09 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:51.437683 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-09d3943c-c9b1-4ee8-be54-3d93145b2f09 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:51.438119 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-09d3943c-c9b1-4ee8-be54-3d93145b2f09 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:51.438820 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-09d3943c-c9b1-4ee8-be54-3d93145b2f09 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:51.439272 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-09d3943c-c9b1-4ee8-be54-3d93145b2f09 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:51.439722 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-09d3943c-c9b1-4ee8-be54-3d93145b2f09 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:51.493725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2562a21d-f524-41e5-855d-d69eca0bc707 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:51.494369 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2562a21d-f524-41e5-855d-d69eca0bc707 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:51.500378 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2562a21d-f524-41e5-855d-d69eca0bc707 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:51.500855 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2562a21d-f524-41e5-855d-d69eca0bc707 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:51.502063 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2562a21d-f524-41e5-855d-d69eca0bc707 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:51.502767 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2562a21d-f524-41e5-855d-d69eca0bc707 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:51.503220 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2562a21d-f524-41e5-855d-d69eca0bc707 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:51.504301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2562a21d-f524-41e5-855d-d69eca0bc707 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:51.577239 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-09d3943c-c9b1-4ee8-be54-3d93145b2f09 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:51.592820 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-09d3943c-c9b1-4ee8-be54-3d93145b2f09 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:51.594940 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-09d3943c-c9b1-4ee8-be54-3d93145b2f09 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:51.596121 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-09d3943c-c9b1-4ee8-be54-3d93145b2f09 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.169819 Aug 24 17:53:51.597033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 324/621] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:51 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:51.646521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2562a21d-f524-41e5-855d-d69eca0bc707 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:51.654077 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2562a21d-f524-41e5-855d-d69eca0bc707 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1367 microversion: 2.1 time: 0.164497 Aug 24 17:53:51.654635 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 298/622] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:51 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:52.619006 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7f7d91b8-0bba-430a-8947-4f6ae00feab2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:52.619645 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7f7d91b8-0bba-430a-8947-4f6ae00feab2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:52.625983 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7f7d91b8-0bba-430a-8947-4f6ae00feab2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:52.626460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7f7d91b8-0bba-430a-8947-4f6ae00feab2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:52.626887 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7f7d91b8-0bba-430a-8947-4f6ae00feab2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:52.627610 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7f7d91b8-0bba-430a-8947-4f6ae00feab2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:52.628055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7f7d91b8-0bba-430a-8947-4f6ae00feab2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:52.628472 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7f7d91b8-0bba-430a-8947-4f6ae00feab2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:52.676458 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9d7fb649-cbb5-44da-a8e2-152cc978ce92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:52.677713 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9d7fb649-cbb5-44da-a8e2-152cc978ce92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:52.684321 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9d7fb649-cbb5-44da-a8e2-152cc978ce92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:52.684804 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9d7fb649-cbb5-44da-a8e2-152cc978ce92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:52.685235 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9d7fb649-cbb5-44da-a8e2-152cc978ce92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:52.685924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9d7fb649-cbb5-44da-a8e2-152cc978ce92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:52.686373 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9d7fb649-cbb5-44da-a8e2-152cc978ce92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:52.686788 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9d7fb649-cbb5-44da-a8e2-152cc978ce92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:52.759013 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7f7d91b8-0bba-430a-8947-4f6ae00feab2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:52.767473 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7f7d91b8-0bba-430a-8947-4f6ae00feab2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:52.768998 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7f7d91b8-0bba-430a-8947-4f6ae00feab2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:52.770154 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7f7d91b8-0bba-430a-8947-4f6ae00feab2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.155110 Aug 24 17:53:52.770711 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 325/623] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:52 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:52.814222 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9d7fb649-cbb5-44da-a8e2-152cc978ce92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:52.821716 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9d7fb649-cbb5-44da-a8e2-152cc978ce92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1367 microversion: 2.1 time: 0.149799 Aug 24 17:53:52.822266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 299/624] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:52 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:53.793871 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-565483f1-2cdb-4446-802b-5454c8a9d0ae tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:53.794398 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-565483f1-2cdb-4446-802b-5454c8a9d0ae tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:53.802224 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-565483f1-2cdb-4446-802b-5454c8a9d0ae tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:53.802713 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-565483f1-2cdb-4446-802b-5454c8a9d0ae tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:53.803145 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-565483f1-2cdb-4446-802b-5454c8a9d0ae tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:53.803863 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-565483f1-2cdb-4446-802b-5454c8a9d0ae tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:53.804322 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-565483f1-2cdb-4446-802b-5454c8a9d0ae tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:53.804746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-565483f1-2cdb-4446-802b-5454c8a9d0ae tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:53.842228 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7480776f-c331-4b2e-a21d-5815b3ae2dd2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:53.842852 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7480776f-c331-4b2e-a21d-5815b3ae2dd2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:53.849586 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7480776f-c331-4b2e-a21d-5815b3ae2dd2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:53.850052 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7480776f-c331-4b2e-a21d-5815b3ae2dd2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:53.850493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7480776f-c331-4b2e-a21d-5815b3ae2dd2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:53.851174 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7480776f-c331-4b2e-a21d-5815b3ae2dd2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:53.851673 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7480776f-c331-4b2e-a21d-5815b3ae2dd2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:53.852091 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7480776f-c331-4b2e-a21d-5815b3ae2dd2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:53.939198 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-565483f1-2cdb-4446-802b-5454c8a9d0ae tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:53.948308 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-565483f1-2cdb-4446-802b-5454c8a9d0ae tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:53.950171 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-565483f1-2cdb-4446-802b-5454c8a9d0ae tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:53.951723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-565483f1-2cdb-4446-802b-5454c8a9d0ae tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.161905 Aug 24 17:53:53.952373 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 326/625] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:53 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:53.986822 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7480776f-c331-4b2e-a21d-5815b3ae2dd2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:53.995636 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7480776f-c331-4b2e-a21d-5815b3ae2dd2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1367 microversion: 2.1 time: 0.157176 Aug 24 17:53:53.996206 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 300/626] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:53 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:54.975785 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-40e509c8-c013-4837-a62d-3baa1ac31429 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:54.976416 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-40e509c8-c013-4837-a62d-3baa1ac31429 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:54.982802 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-40e509c8-c013-4837-a62d-3baa1ac31429 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:54.983282 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-40e509c8-c013-4837-a62d-3baa1ac31429 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:54.983753 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-40e509c8-c013-4837-a62d-3baa1ac31429 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:54.984435 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-40e509c8-c013-4837-a62d-3baa1ac31429 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:54.984886 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-40e509c8-c013-4837-a62d-3baa1ac31429 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:54.985306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-40e509c8-c013-4837-a62d-3baa1ac31429 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:55.017760 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-473ed3c2-b5d8-40c3-a2de-019ff1fad509 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:55.018495 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-473ed3c2-b5d8-40c3-a2de-019ff1fad509 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:55.025034 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-473ed3c2-b5d8-40c3-a2de-019ff1fad509 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:55.025602 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-473ed3c2-b5d8-40c3-a2de-019ff1fad509 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:55.026110 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-473ed3c2-b5d8-40c3-a2de-019ff1fad509 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:55.026891 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-473ed3c2-b5d8-40c3-a2de-019ff1fad509 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:55.027415 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-473ed3c2-b5d8-40c3-a2de-019ff1fad509 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:55.027937 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-473ed3c2-b5d8-40c3-a2de-019ff1fad509 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:55.119958 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-40e509c8-c013-4837-a62d-3baa1ac31429 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:55.129111 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-40e509c8-c013-4837-a62d-3baa1ac31429 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:55.130663 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-40e509c8-c013-4837-a62d-3baa1ac31429 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:55.131876 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-40e509c8-c013-4837-a62d-3baa1ac31429 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.160070 Aug 24 17:53:55.132444 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 327/627] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:54 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:55.164799 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-473ed3c2-b5d8-40c3-a2de-019ff1fad509 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:55.172821 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-473ed3c2-b5d8-40c3-a2de-019ff1fad509 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1367 microversion: 2.1 time: 0.159668 Aug 24 17:53:55.173388 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 301/628] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:55 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:55.607021 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-aa1d0f9a-fcfd-4d93-976b-cc1a742fa720 req-c013f2ef-8785-4983-aa2f-380fb0cbdd03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e207e34-6199-4650-9358-5ef1fd30774a", "name": "network-vif-plugged", "status": "completed", "tag": "8c02114c-93ee-4d8c-9f80-148768e58b93"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:55.618402 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-aa1d0f9a-fcfd-4d93-976b-cc1a742fa720 req-c013f2ef-8785-4983-aa2f-380fb0cbdd03 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:55.618883 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-aa1d0f9a-fcfd-4d93-976b-cc1a742fa720 req-c013f2ef-8785-4983-aa2f-380fb0cbdd03 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:55.619309 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-aa1d0f9a-fcfd-4d93-976b-cc1a742fa720 req-c013f2ef-8785-4983-aa2f-380fb0cbdd03 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:55.630218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-aa1d0f9a-fcfd-4d93-976b-cc1a742fa720 req-c013f2ef-8785-4983-aa2f-380fb0cbdd03 service nova] Creating event network-vif-plugged:8c02114c-93ee-4d8c-9f80-148768e58b93 for instance 2e207e34-6199-4650-9358-5ef1fd30774a on hv-cinder-84052 Aug 24 17:53:55.635673 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-aa1d0f9a-fcfd-4d93-976b-cc1a742fa720 req-c013f2ef-8785-4983-aa2f-380fb0cbdd03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089249 Aug 24 17:53:55.636268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 328/629] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:55.689122 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4624098d-b02c-4b05-8881-c7ce796f4f0e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:55.689767 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4624098d-b02c-4b05-8881-c7ce796f4f0e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:55.695831 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4624098d-b02c-4b05-8881-c7ce796f4f0e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:55.696414 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4624098d-b02c-4b05-8881-c7ce796f4f0e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:55.696853 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4624098d-b02c-4b05-8881-c7ce796f4f0e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:55.698110 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4624098d-b02c-4b05-8881-c7ce796f4f0e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:55.698594 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4624098d-b02c-4b05-8881-c7ce796f4f0e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:55.699016 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4624098d-b02c-4b05-8881-c7ce796f4f0e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:55.724441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-4624098d-b02c-4b05-8881-c7ce796f4f0e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lazy-loading 'flavor' on Instance uuid aa859353-b309-4c9b-8f43-21b185b4f27d {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:53:55.800662 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4624098d-b02c-4b05-8881-c7ce796f4f0e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "POST /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d/action" status: 202 len: 0 microversion: 2.1 time: 0.115184 Aug 24 17:53:55.801691 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 302/630] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:53:55 2022] POST /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:53:55.810740 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-aeabf348-1e5a-4889-8a71-3a49af4265fb tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:55.814285 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-aeabf348-1e5a-4889-8a71-3a49af4265fb tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:55.820579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aeabf348-1e5a-4889-8a71-3a49af4265fb tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:55.821088 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aeabf348-1e5a-4889-8a71-3a49af4265fb tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:55.821659 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aeabf348-1e5a-4889-8a71-3a49af4265fb tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:55.822374 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aeabf348-1e5a-4889-8a71-3a49af4265fb tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:55.822892 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aeabf348-1e5a-4889-8a71-3a49af4265fb tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:55.823262 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aeabf348-1e5a-4889-8a71-3a49af4265fb tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:55.967849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-aeabf348-1e5a-4889-8a71-3a49af4265fb tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:55.976251 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-aeabf348-1e5a-4889-8a71-3a49af4265fb tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.170068 Aug 24 17:53:55.976798 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 329/631] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:55 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:56.157643 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-55584176-164c-4541-aa76-91dc3b9f5148 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:56.158257 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-55584176-164c-4541-aa76-91dc3b9f5148 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:56.164452 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-55584176-164c-4541-aa76-91dc3b9f5148 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:56.164933 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-55584176-164c-4541-aa76-91dc3b9f5148 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:56.165367 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-55584176-164c-4541-aa76-91dc3b9f5148 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:56.166049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-55584176-164c-4541-aa76-91dc3b9f5148 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:56.166503 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-55584176-164c-4541-aa76-91dc3b9f5148 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:56.166927 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-55584176-164c-4541-aa76-91dc3b9f5148 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:56.193854 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fc49cadc-a9f8-476c-86e3-a05336485793 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:56.194463 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-fc49cadc-a9f8-476c-86e3-a05336485793 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:56.200912 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fc49cadc-a9f8-476c-86e3-a05336485793 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:56.201406 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fc49cadc-a9f8-476c-86e3-a05336485793 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:56.201843 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fc49cadc-a9f8-476c-86e3-a05336485793 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:56.202537 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fc49cadc-a9f8-476c-86e3-a05336485793 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:56.203508 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fc49cadc-a9f8-476c-86e3-a05336485793 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:56.203931 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fc49cadc-a9f8-476c-86e3-a05336485793 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:56.299582 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-55584176-164c-4541-aa76-91dc3b9f5148 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:56.307874 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-55584176-164c-4541-aa76-91dc3b9f5148 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:56.309375 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-55584176-164c-4541-aa76-91dc3b9f5148 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:56.310534 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-55584176-164c-4541-aa76-91dc3b9f5148 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.158417 Aug 24 17:53:56.311094 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 303/632] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:56 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:56.334658 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fc49cadc-a9f8-476c-86e3-a05336485793 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:56.342344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-fc49cadc-a9f8-476c-86e3-a05336485793 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1367 microversion: 2.1 time: 0.152391 Aug 24 17:53:56.342909 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 330/633] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:56 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:56.997213 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b9a8d8f0-785a-4cc0-8e36-f2eeed617a04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:56.997930 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b9a8d8f0-785a-4cc0-8e36-f2eeed617a04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:57.000543 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:57.001211 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=6 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:57.006835 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b9a8d8f0-785a-4cc0-8e36-f2eeed617a04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:57.007324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b9a8d8f0-785a-4cc0-8e36-f2eeed617a04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:57.007787 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b9a8d8f0-785a-4cc0-8e36-f2eeed617a04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:57.008516 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b9a8d8f0-785a-4cc0-8e36-f2eeed617a04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:57.008974 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b9a8d8f0-785a-4cc0-8e36-f2eeed617a04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:57.009403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b9a8d8f0-785a-4cc0-8e36-f2eeed617a04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:57.139230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b9a8d8f0-785a-4cc0-8e36-f2eeed617a04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:57.147761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b9a8d8f0-785a-4cc0-8e36-f2eeed617a04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.154414 Aug 24 17:53:57.148332 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 304/634] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:56 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:57.333298 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-59f1539c-a130-4cc7-9c2f-0f6cd51af954 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:57.333912 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-59f1539c-a130-4cc7-9c2f-0f6cd51af954 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:57.335908 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=6 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:57.341785 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-59f1539c-a130-4cc7-9c2f-0f6cd51af954 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:57.342270 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-59f1539c-a130-4cc7-9c2f-0f6cd51af954 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:57.342704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-59f1539c-a130-4cc7-9c2f-0f6cd51af954 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:57.343925 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-59f1539c-a130-4cc7-9c2f-0f6cd51af954 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:57.344379 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-59f1539c-a130-4cc7-9c2f-0f6cd51af954 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:57.344799 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-59f1539c-a130-4cc7-9c2f-0f6cd51af954 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:57.364164 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-cfbc1d7f-5f74-4e79-878f-43d058bccc16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:57.364793 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-cfbc1d7f-5f74-4e79-878f-43d058bccc16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:57.371151 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cfbc1d7f-5f74-4e79-878f-43d058bccc16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:57.371690 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cfbc1d7f-5f74-4e79-878f-43d058bccc16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:57.372766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cfbc1d7f-5f74-4e79-878f-43d058bccc16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:57.373398 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cfbc1d7f-5f74-4e79-878f-43d058bccc16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:57.373398 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cfbc1d7f-5f74-4e79-878f-43d058bccc16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:57.373685 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cfbc1d7f-5f74-4e79-878f-43d058bccc16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:57.500646 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-59f1539c-a130-4cc7-9c2f-0f6cd51af954 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:57.509204 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-59f1539c-a130-4cc7-9c2f-0f6cd51af954 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:57.511250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-59f1539c-a130-4cc7-9c2f-0f6cd51af954 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:57.512024 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-cfbc1d7f-5f74-4e79-878f-43d058bccc16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:57.512446 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-59f1539c-a130-4cc7-9c2f-0f6cd51af954 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.183329 Aug 24 17:53:57.512999 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 331/635] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:57 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:57.520849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-cfbc1d7f-5f74-4e79-878f-43d058bccc16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1367 microversion: 2.1 time: 0.160354 Aug 24 17:53:57.521499 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 305/636] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:57 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:58.172119 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0c203581-f94e-4de7-8f27-bbcb5713ec27 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:58.172654 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0c203581-f94e-4de7-8f27-bbcb5713ec27 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:58.178691 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0c203581-f94e-4de7-8f27-bbcb5713ec27 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:58.179214 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0c203581-f94e-4de7-8f27-bbcb5713ec27 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:58.179661 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0c203581-f94e-4de7-8f27-bbcb5713ec27 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:58.180367 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0c203581-f94e-4de7-8f27-bbcb5713ec27 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:58.180812 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0c203581-f94e-4de7-8f27-bbcb5713ec27 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:58.181231 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0c203581-f94e-4de7-8f27-bbcb5713ec27 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:58.195953 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:58.312799 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0c203581-f94e-4de7-8f27-bbcb5713ec27 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:58.320509 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0c203581-f94e-4de7-8f27-bbcb5713ec27 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.152414 Aug 24 17:53:58.321076 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 332/637] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:58 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:58.535535 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0c75fd77-ad1b-4b49-8f34-c1b216127e8d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:58.536154 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0c75fd77-ad1b-4b49-8f34-c1b216127e8d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:58.541393 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1f7c3f0c-0b4f-4c09-a611-d7fde4e11d80 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:58.542009 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1f7c3f0c-0b4f-4c09-a611-d7fde4e11d80 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:58.543072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0c75fd77-ad1b-4b49-8f34-c1b216127e8d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:58.543598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0c75fd77-ad1b-4b49-8f34-c1b216127e8d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:58.544035 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0c75fd77-ad1b-4b49-8f34-c1b216127e8d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:58.544733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0c75fd77-ad1b-4b49-8f34-c1b216127e8d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:58.545191 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0c75fd77-ad1b-4b49-8f34-c1b216127e8d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:58.545615 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0c75fd77-ad1b-4b49-8f34-c1b216127e8d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:58.548475 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f7c3f0c-0b4f-4c09-a611-d7fde4e11d80 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:58.548959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f7c3f0c-0b4f-4c09-a611-d7fde4e11d80 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:58.549395 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f7c3f0c-0b4f-4c09-a611-d7fde4e11d80 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:58.550082 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f7c3f0c-0b4f-4c09-a611-d7fde4e11d80 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:58.550537 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f7c3f0c-0b4f-4c09-a611-d7fde4e11d80 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:58.550959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f7c3f0c-0b4f-4c09-a611-d7fde4e11d80 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:58.560389 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:53:58.679391 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1f7c3f0c-0b4f-4c09-a611-d7fde4e11d80 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:58.679569 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0c75fd77-ad1b-4b49-8f34-c1b216127e8d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:58.688173 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1f7c3f0c-0b4f-4c09-a611-d7fde4e11d80 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1557 microversion: 2.1 time: 0.150518 Aug 24 17:53:58.688475 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0c75fd77-ad1b-4b49-8f34-c1b216127e8d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:58.688758 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 333/638] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:58 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:53:58.690003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0c75fd77-ad1b-4b49-8f34-c1b216127e8d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:58.691161 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0c75fd77-ad1b-4b49-8f34-c1b216127e8d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.159685 Aug 24 17:53:58.691735 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 306/639] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:58 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:53:58.708961 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a3291ac6-6dba-4050-8c5f-7e47f9ad87d0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:58.709454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a3291ac6-6dba-4050-8c5f-7e47f9ad87d0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:58.715568 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a3291ac6-6dba-4050-8c5f-7e47f9ad87d0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:58.716049 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a3291ac6-6dba-4050-8c5f-7e47f9ad87d0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:58.716482 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a3291ac6-6dba-4050-8c5f-7e47f9ad87d0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:58.717172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a3291ac6-6dba-4050-8c5f-7e47f9ad87d0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:58.717622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a3291ac6-6dba-4050-8c5f-7e47f9ad87d0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:58.718044 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a3291ac6-6dba-4050-8c5f-7e47f9ad87d0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:58.796832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a3291ac6-6dba-4050-8c5f-7e47f9ad87d0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091948 Aug 24 17:53:58.797445 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 334/640] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 17:53:58 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:53:59.342059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4299a0b6-e0c5-4188-9cd1-0798ceb60c3d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:59.342670 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4299a0b6-e0c5-4188-9cd1-0798ceb60c3d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:59.349016 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4299a0b6-e0c5-4188-9cd1-0798ceb60c3d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:59.349493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4299a0b6-e0c5-4188-9cd1-0798ceb60c3d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:59.349927 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4299a0b6-e0c5-4188-9cd1-0798ceb60c3d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:59.350613 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4299a0b6-e0c5-4188-9cd1-0798ceb60c3d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:59.351060 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4299a0b6-e0c5-4188-9cd1-0798ceb60c3d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:59.351585 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4299a0b6-e0c5-4188-9cd1-0798ceb60c3d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:59.481161 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4299a0b6-e0c5-4188-9cd1-0798ceb60c3d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:59.489681 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4299a0b6-e0c5-4188-9cd1-0798ceb60c3d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.151411 Aug 24 17:53:59.490262 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 307/641] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:53:59 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:53:59.701750 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-08bfd2b3-4928-4367-8bb8-d42d8e0c8005 req-af6b6ea3-455d-4839-927e-e7fc61398dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e207e34-6199-4650-9358-5ef1fd30774a", "tag": "8c02114c-93ee-4d8c-9f80-148768e58b93"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:53:59.711791 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-08bfd2b3-4928-4367-8bb8-d42d8e0c8005 req-af6b6ea3-455d-4839-927e-e7fc61398dd7 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:59.712367 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-08bfd2b3-4928-4367-8bb8-d42d8e0c8005 req-af6b6ea3-455d-4839-927e-e7fc61398dd7 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:59.712876 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-08bfd2b3-4928-4367-8bb8-d42d8e0c8005 req-af6b6ea3-455d-4839-927e-e7fc61398dd7 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:59.714243 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1e1b5e0d-018c-45f8-a237-73027dfe9ead tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:53:59.714755 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1e1b5e0d-018c-45f8-a237-73027dfe9ead tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:53:59.721494 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1e1b5e0d-018c-45f8-a237-73027dfe9ead tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:59.721981 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1e1b5e0d-018c-45f8-a237-73027dfe9ead tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:59.722407 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1e1b5e0d-018c-45f8-a237-73027dfe9ead tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:59.723104 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1e1b5e0d-018c-45f8-a237-73027dfe9ead tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:53:59.723660 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1e1b5e0d-018c-45f8-a237-73027dfe9ead tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:53:59.724005 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1e1b5e0d-018c-45f8-a237-73027dfe9ead tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:53:59.725714 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-08bfd2b3-4928-4367-8bb8-d42d8e0c8005 req-af6b6ea3-455d-4839-927e-e7fc61398dd7 service nova] Creating event network-changed:8c02114c-93ee-4d8c-9f80-148768e58b93 for instance 2e207e34-6199-4650-9358-5ef1fd30774a on hv-cinder-84052 Aug 24 17:53:59.733166 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-08bfd2b3-4928-4367-8bb8-d42d8e0c8005 req-af6b6ea3-455d-4839-927e-e7fc61398dd7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035552 Aug 24 17:53:59.734346 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 335/642] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:53:59.963766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1e1b5e0d-018c-45f8-a237-73027dfe9ead tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:59.972243 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1e1b5e0d-018c-45f8-a237-73027dfe9ead tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:59.973853 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1e1b5e0d-018c-45f8-a237-73027dfe9ead tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:53:59.975102 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1e1b5e0d-018c-45f8-a237-73027dfe9ead tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.264824 Aug 24 17:53:59.975967 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 308/643] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:53:59 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:54:00.510879 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-eb73f07f-a5be-4920-9eb7-59a5c535e3ff tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:00.511612 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-eb73f07f-a5be-4920-9eb7-59a5c535e3ff tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:00.518571 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-eb73f07f-a5be-4920-9eb7-59a5c535e3ff tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:00.519075 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-eb73f07f-a5be-4920-9eb7-59a5c535e3ff tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:00.519699 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-eb73f07f-a5be-4920-9eb7-59a5c535e3ff tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:00.520417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-eb73f07f-a5be-4920-9eb7-59a5c535e3ff tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:00.520911 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-eb73f07f-a5be-4920-9eb7-59a5c535e3ff tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:00.521340 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-eb73f07f-a5be-4920-9eb7-59a5c535e3ff tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:00.661047 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-eb73f07f-a5be-4920-9eb7-59a5c535e3ff tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:00.668926 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-eb73f07f-a5be-4920-9eb7-59a5c535e3ff tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.162460 Aug 24 17:54:00.669740 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 336/644] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:00 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:00.997497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-041c8780-1e80-442c-999b-450065f68721 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:00.998103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-041c8780-1e80-442c-999b-450065f68721 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:01.005076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-041c8780-1e80-442c-999b-450065f68721 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:01.005552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-041c8780-1e80-442c-999b-450065f68721 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:01.005978 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-041c8780-1e80-442c-999b-450065f68721 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:01.006658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-041c8780-1e80-442c-999b-450065f68721 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:01.007107 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-041c8780-1e80-442c-999b-450065f68721 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:01.007555 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-041c8780-1e80-442c-999b-450065f68721 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:01.137142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-041c8780-1e80-442c-999b-450065f68721 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:01.145936 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-041c8780-1e80-442c-999b-450065f68721 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:01.147869 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-041c8780-1e80-442c-999b-450065f68721 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:01.148956 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-041c8780-1e80-442c-999b-450065f68721 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.155310 Aug 24 17:54:01.149513 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 309/645] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:00 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:01.690061 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a8a6884e-8af6-4e80-a6a1-a0bcf4e58b70 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:01.690703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a8a6884e-8af6-4e80-a6a1-a0bcf4e58b70 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:01.697350 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8a6884e-8af6-4e80-a6a1-a0bcf4e58b70 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:01.697838 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8a6884e-8af6-4e80-a6a1-a0bcf4e58b70 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:01.698278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8a6884e-8af6-4e80-a6a1-a0bcf4e58b70 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:01.698970 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8a6884e-8af6-4e80-a6a1-a0bcf4e58b70 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:01.699428 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8a6884e-8af6-4e80-a6a1-a0bcf4e58b70 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:01.699878 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a8a6884e-8af6-4e80-a6a1-a0bcf4e58b70 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:01.829960 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a8a6884e-8af6-4e80-a6a1-a0bcf4e58b70 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:01.837983 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a8a6884e-8af6-4e80-a6a1-a0bcf4e58b70 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.151867 Aug 24 17:54:01.838546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 337/646] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:01 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:02.171457 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6d7e8a2f-ebb0-4290-b363-725357697a2f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:02.172020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6d7e8a2f-ebb0-4290-b363-725357697a2f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:02.178365 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6d7e8a2f-ebb0-4290-b363-725357697a2f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:02.178839 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6d7e8a2f-ebb0-4290-b363-725357697a2f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:02.179264 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6d7e8a2f-ebb0-4290-b363-725357697a2f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:02.179966 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6d7e8a2f-ebb0-4290-b363-725357697a2f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:02.180413 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6d7e8a2f-ebb0-4290-b363-725357697a2f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:02.180825 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6d7e8a2f-ebb0-4290-b363-725357697a2f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:02.311818 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6d7e8a2f-ebb0-4290-b363-725357697a2f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:02.320509 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6d7e8a2f-ebb0-4290-b363-725357697a2f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:02.322017 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6d7e8a2f-ebb0-4290-b363-725357697a2f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:02.323172 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6d7e8a2f-ebb0-4290-b363-725357697a2f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.155674 Aug 24 17:54:02.323756 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 310/647] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:02 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:02.859564 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-10850cc3-9480-45dd-98c2-b6ee8fdb4542 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:02.860131 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-10850cc3-9480-45dd-98c2-b6ee8fdb4542 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:02.866769 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10850cc3-9480-45dd-98c2-b6ee8fdb4542 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:02.867260 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10850cc3-9480-45dd-98c2-b6ee8fdb4542 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:02.867726 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10850cc3-9480-45dd-98c2-b6ee8fdb4542 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:02.868425 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10850cc3-9480-45dd-98c2-b6ee8fdb4542 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:02.868880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10850cc3-9480-45dd-98c2-b6ee8fdb4542 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:02.869304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10850cc3-9480-45dd-98c2-b6ee8fdb4542 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:02.997044 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-10850cc3-9480-45dd-98c2-b6ee8fdb4542 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:03.005233 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-10850cc3-9480-45dd-98c2-b6ee8fdb4542 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.150317 Aug 24 17:54:03.005893 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 338/648] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:02 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:03.346267 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-185b29db-05b4-484d-a042-b1476695c268 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:03.346943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-185b29db-05b4-484d-a042-b1476695c268 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:03.353420 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-185b29db-05b4-484d-a042-b1476695c268 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:03.353905 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-185b29db-05b4-484d-a042-b1476695c268 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:03.354344 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-185b29db-05b4-484d-a042-b1476695c268 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:03.355038 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-185b29db-05b4-484d-a042-b1476695c268 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:03.355517 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-185b29db-05b4-484d-a042-b1476695c268 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:03.355947 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-185b29db-05b4-484d-a042-b1476695c268 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:03.483169 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-185b29db-05b4-484d-a042-b1476695c268 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:03.491886 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-185b29db-05b4-484d-a042-b1476695c268 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:03.493408 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-185b29db-05b4-484d-a042-b1476695c268 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:03.494571 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-185b29db-05b4-484d-a042-b1476695c268 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.152204 Aug 24 17:54:03.495132 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 311/649] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:03 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:04.026105 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-49bd5a6b-10a1-4d43-87d5-5b81fda2a9fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:04.026723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-49bd5a6b-10a1-4d43-87d5-5b81fda2a9fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:04.033622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-49bd5a6b-10a1-4d43-87d5-5b81fda2a9fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:04.034107 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-49bd5a6b-10a1-4d43-87d5-5b81fda2a9fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:04.034545 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-49bd5a6b-10a1-4d43-87d5-5b81fda2a9fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:04.035230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-49bd5a6b-10a1-4d43-87d5-5b81fda2a9fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:04.035709 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-49bd5a6b-10a1-4d43-87d5-5b81fda2a9fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:04.036132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-49bd5a6b-10a1-4d43-87d5-5b81fda2a9fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:04.169017 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-49bd5a6b-10a1-4d43-87d5-5b81fda2a9fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:04.177265 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-49bd5a6b-10a1-4d43-87d5-5b81fda2a9fa tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.154995 Aug 24 17:54:04.177839 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 339/650] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:04 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:04.517743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ebde6514-7f94-4250-815c-4a868a78e09c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:04.518363 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ebde6514-7f94-4250-815c-4a868a78e09c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:04.524860 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebde6514-7f94-4250-815c-4a868a78e09c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:04.525347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebde6514-7f94-4250-815c-4a868a78e09c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:04.525788 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebde6514-7f94-4250-815c-4a868a78e09c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:04.526485 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebde6514-7f94-4250-815c-4a868a78e09c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:04.526943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebde6514-7f94-4250-815c-4a868a78e09c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:04.527377 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebde6514-7f94-4250-815c-4a868a78e09c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:04.659049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ebde6514-7f94-4250-815c-4a868a78e09c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:04.667141 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ebde6514-7f94-4250-815c-4a868a78e09c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:04.668692 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ebde6514-7f94-4250-815c-4a868a78e09c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:04.669870 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ebde6514-7f94-4250-815c-4a868a78e09c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.156039 Aug 24 17:54:04.670437 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 312/651] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:04 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:05.199203 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-963436a6-863a-462f-a513-bb59539993fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:05.200057 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-963436a6-863a-462f-a513-bb59539993fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:05.207211 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-963436a6-863a-462f-a513-bb59539993fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:05.207729 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-963436a6-863a-462f-a513-bb59539993fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:05.208165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-963436a6-863a-462f-a513-bb59539993fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:05.208849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-963436a6-863a-462f-a513-bb59539993fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:05.209474 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-963436a6-863a-462f-a513-bb59539993fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:05.209893 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-963436a6-863a-462f-a513-bb59539993fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:05.344527 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-963436a6-863a-462f-a513-bb59539993fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:05.353291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-963436a6-863a-462f-a513-bb59539993fe tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.158727 Aug 24 17:54:05.354174 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 340/652] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:05 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:05.598872 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9124c9dc-8b48-496a-a540-12cd16340f3b tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:05.601298 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9124c9dc-8b48-496a-a540-12cd16340f3b tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:05.607916 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9124c9dc-8b48-496a-a540-12cd16340f3b tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:05.608407 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9124c9dc-8b48-496a-a540-12cd16340f3b tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:05.608846 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9124c9dc-8b48-496a-a540-12cd16340f3b tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:05.609551 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9124c9dc-8b48-496a-a540-12cd16340f3b tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:05.610006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9124c9dc-8b48-496a-a540-12cd16340f3b tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:05.610430 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9124c9dc-8b48-496a-a540-12cd16340f3b tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:05.682510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9124c9dc-8b48-496a-a540-12cd16340f3b tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "POST /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/action" status: 202 len: 0 microversion: 2.1 time: 0.087219 Aug 24 17:54:05.683142 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 313/653] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:54:05 2022] POST /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:54:05.692950 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6d6f5a02-f544-415d-901a-be6d176c06dd tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:05.693160 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-6d6f5a02-f544-415d-901a-be6d176c06dd tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:05.694505 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-407eb6b3-b909-4182-bd89-cbc601fba1a5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:05.695390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-407eb6b3-b909-4182-bd89-cbc601fba1a5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:05.700364 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6d6f5a02-f544-415d-901a-be6d176c06dd tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:05.700903 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6d6f5a02-f544-415d-901a-be6d176c06dd tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:05.701303 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6d6f5a02-f544-415d-901a-be6d176c06dd tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:05.702019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6d6f5a02-f544-415d-901a-be6d176c06dd tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:05.702513 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6d6f5a02-f544-415d-901a-be6d176c06dd tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:05.702664 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-407eb6b3-b909-4182-bd89-cbc601fba1a5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:05.703026 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-407eb6b3-b909-4182-bd89-cbc601fba1a5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:05.703427 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6d6f5a02-f544-415d-901a-be6d176c06dd tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:05.703592 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-407eb6b3-b909-4182-bd89-cbc601fba1a5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:05.704244 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-407eb6b3-b909-4182-bd89-cbc601fba1a5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:05.705472 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-407eb6b3-b909-4182-bd89-cbc601fba1a5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:05.706562 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-407eb6b3-b909-4182-bd89-cbc601fba1a5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:05.855556 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6d6f5a02-f544-415d-901a-be6d176c06dd tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:05.864310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6d6f5a02-f544-415d-901a-be6d176c06dd tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1749 microversion: 2.1 time: 0.176089 Aug 24 17:54:05.864874 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 341/654] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:05 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1749 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:05.937952 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-407eb6b3-b909-4182-bd89-cbc601fba1a5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:05.946102 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-407eb6b3-b909-4182-bd89-cbc601fba1a5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:05.947640 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-407eb6b3-b909-4182-bd89-cbc601fba1a5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:05.948800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-407eb6b3-b909-4182-bd89-cbc601fba1a5 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.258842 Aug 24 17:54:05.949361 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 314/655] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:05 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:54:06.374894 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3af429c4-5898-4018-ba24-538ffd37fb01 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:06.375535 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3af429c4-5898-4018-ba24-538ffd37fb01 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:06.382332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3af429c4-5898-4018-ba24-538ffd37fb01 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:06.382819 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3af429c4-5898-4018-ba24-538ffd37fb01 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:06.383254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3af429c4-5898-4018-ba24-538ffd37fb01 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:06.383975 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3af429c4-5898-4018-ba24-538ffd37fb01 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:06.384435 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3af429c4-5898-4018-ba24-538ffd37fb01 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:06.384864 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3af429c4-5898-4018-ba24-538ffd37fb01 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:06.516118 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3af429c4-5898-4018-ba24-538ffd37fb01 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:06.524210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3af429c4-5898-4018-ba24-538ffd37fb01 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.153314 Aug 24 17:54:06.524789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 342/656] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:06 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:06.885935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ef5496ef-9a73-4975-838e-1ec09c58c918 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:06.886553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ef5496ef-9a73-4975-838e-1ec09c58c918 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:06.893682 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ef5496ef-9a73-4975-838e-1ec09c58c918 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:06.894173 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ef5496ef-9a73-4975-838e-1ec09c58c918 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:06.894613 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ef5496ef-9a73-4975-838e-1ec09c58c918 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:06.895315 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ef5496ef-9a73-4975-838e-1ec09c58c918 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:06.895808 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ef5496ef-9a73-4975-838e-1ec09c58c918 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:06.896235 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ef5496ef-9a73-4975-838e-1ec09c58c918 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:06.971242 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c8f6c19a-fbc5-4c50-be23-a7116d56fef7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:06.972010 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c8f6c19a-fbc5-4c50-be23-a7116d56fef7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:06.978086 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c8f6c19a-fbc5-4c50-be23-a7116d56fef7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:06.978657 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c8f6c19a-fbc5-4c50-be23-a7116d56fef7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:06.979155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c8f6c19a-fbc5-4c50-be23-a7116d56fef7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:06.980074 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c8f6c19a-fbc5-4c50-be23-a7116d56fef7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:06.980635 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c8f6c19a-fbc5-4c50-be23-a7116d56fef7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:06.981155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c8f6c19a-fbc5-4c50-be23-a7116d56fef7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:07.106657 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ef5496ef-9a73-4975-838e-1ec09c58c918 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:07.115374 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ef5496ef-9a73-4975-838e-1ec09c58c918 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1749 microversion: 2.1 time: 0.233435 Aug 24 17:54:07.115980 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 315/657] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:06 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1749 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:07.126995 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c8f6c19a-fbc5-4c50-be23-a7116d56fef7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:07.135445 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c8f6c19a-fbc5-4c50-be23-a7116d56fef7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:07.137077 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c8f6c19a-fbc5-4c50-be23-a7116d56fef7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:07.138232 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c8f6c19a-fbc5-4c50-be23-a7116d56fef7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.171069 Aug 24 17:54:07.138824 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 343/658] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:06 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:54:07.545815 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4da8597f-0031-4d7f-82f9-54dba70fb12f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:07.547047 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4da8597f-0031-4d7f-82f9-54dba70fb12f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:07.552988 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4da8597f-0031-4d7f-82f9-54dba70fb12f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:07.553474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4da8597f-0031-4d7f-82f9-54dba70fb12f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:07.553908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4da8597f-0031-4d7f-82f9-54dba70fb12f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:07.554628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4da8597f-0031-4d7f-82f9-54dba70fb12f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:07.555089 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4da8597f-0031-4d7f-82f9-54dba70fb12f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:07.555539 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4da8597f-0031-4d7f-82f9-54dba70fb12f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:07.682232 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4da8597f-0031-4d7f-82f9-54dba70fb12f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:07.689978 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4da8597f-0031-4d7f-82f9-54dba70fb12f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.148089 Aug 24 17:54:07.690547 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 316/659] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:07 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:08.137118 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e2d85d4c-f583-4448-9ffe-08bab61b45b6 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:08.137903 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e2d85d4c-f583-4448-9ffe-08bab61b45b6 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:08.145165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2d85d4c-f583-4448-9ffe-08bab61b45b6 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:08.145651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2d85d4c-f583-4448-9ffe-08bab61b45b6 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:08.146087 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2d85d4c-f583-4448-9ffe-08bab61b45b6 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:08.146810 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2d85d4c-f583-4448-9ffe-08bab61b45b6 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:08.147266 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2d85d4c-f583-4448-9ffe-08bab61b45b6 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:08.147747 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2d85d4c-f583-4448-9ffe-08bab61b45b6 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:08.161566 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1382ac63-9e35-4ed4-81f0-5c563461d485 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:08.162260 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1382ac63-9e35-4ed4-81f0-5c563461d485 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:08.168557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1382ac63-9e35-4ed4-81f0-5c563461d485 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:08.169046 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1382ac63-9e35-4ed4-81f0-5c563461d485 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:08.169483 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1382ac63-9e35-4ed4-81f0-5c563461d485 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:08.170177 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1382ac63-9e35-4ed4-81f0-5c563461d485 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:08.170635 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1382ac63-9e35-4ed4-81f0-5c563461d485 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:08.171096 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1382ac63-9e35-4ed4-81f0-5c563461d485 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:08.294549 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e2d85d4c-f583-4448-9ffe-08bab61b45b6 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:08.301044 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1382ac63-9e35-4ed4-81f0-5c563461d485 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:08.303525 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e2d85d4c-f583-4448-9ffe-08bab61b45b6 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1754 microversion: 2.1 time: 0.170240 Aug 24 17:54:08.304103 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 344/660] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:08 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:08.309366 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1382ac63-9e35-4ed4-81f0-5c563461d485 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:08.310920 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1382ac63-9e35-4ed4-81f0-5c563461d485 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:08.312140 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1382ac63-9e35-4ed4-81f0-5c563461d485 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1742 microversion: 2.20 time: 0.154512 Aug 24 17:54:08.312733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 317/661] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:08 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:54:08.710385 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3f854c98-a49e-40f9-a594-72b72101122d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:08.711036 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3f854c98-a49e-40f9-a594-72b72101122d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:08.718524 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3f854c98-a49e-40f9-a594-72b72101122d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:08.719014 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3f854c98-a49e-40f9-a594-72b72101122d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:08.719450 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3f854c98-a49e-40f9-a594-72b72101122d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:08.720162 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3f854c98-a49e-40f9-a594-72b72101122d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:08.720612 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3f854c98-a49e-40f9-a594-72b72101122d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:08.721037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3f854c98-a49e-40f9-a594-72b72101122d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:08.864621 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3f854c98-a49e-40f9-a594-72b72101122d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:08.873300 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3f854c98-a49e-40f9-a594-72b72101122d tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.166791 Aug 24 17:54:08.874088 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 345/662] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:08 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:09.324326 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6b51ebe3-2a1c-4473-9bae-fd649787319e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:09.324936 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6b51ebe3-2a1c-4473-9bae-fd649787319e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:09.332112 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6b51ebe3-2a1c-4473-9bae-fd649787319e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.332594 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6b51ebe3-2a1c-4473-9bae-fd649787319e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.333024 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6b51ebe3-2a1c-4473-9bae-fd649787319e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.333709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6b51ebe3-2a1c-4473-9bae-fd649787319e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.334156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6b51ebe3-2a1c-4473-9bae-fd649787319e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.334572 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6b51ebe3-2a1c-4473-9bae-fd649787319e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.335217 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e2c18651-f730-46cd-9605-f95c8b9e7d6d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:09.335948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e2c18651-f730-46cd-9605-f95c8b9e7d6d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:09.342489 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2c18651-f730-46cd-9605-f95c8b9e7d6d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.343040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2c18651-f730-46cd-9605-f95c8b9e7d6d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.343427 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2c18651-f730-46cd-9605-f95c8b9e7d6d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.344115 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2c18651-f730-46cd-9605-f95c8b9e7d6d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.344591 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2c18651-f730-46cd-9605-f95c8b9e7d6d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.345027 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e2c18651-f730-46cd-9605-f95c8b9e7d6d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.488868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e2c18651-f730-46cd-9605-f95c8b9e7d6d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:09.498310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e2c18651-f730-46cd-9605-f95c8b9e7d6d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:09.500753 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e2c18651-f730-46cd-9605-f95c8b9e7d6d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:09.502487 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e2c18651-f730-46cd-9605-f95c8b9e7d6d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1742 microversion: 2.20 time: 0.171958 Aug 24 17:54:09.503855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 346/663] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:09 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:54:09.505183 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6b51ebe3-2a1c-4473-9bae-fd649787319e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:09.515170 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6b51ebe3-2a1c-4473-9bae-fd649787319e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1754 microversion: 2.1 time: 0.194484 Aug 24 17:54:09.528638 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 318/664] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:09 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:09.795210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-256690d2-8d4e-4b97-8d7d-30d11b5f6bd1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:09.795813 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-256690d2-8d4e-4b97-8d7d-30d11b5f6bd1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:09.802730 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-256690d2-8d4e-4b97-8d7d-30d11b5f6bd1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.803245 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-256690d2-8d4e-4b97-8d7d-30d11b5f6bd1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.803707 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-256690d2-8d4e-4b97-8d7d-30d11b5f6bd1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.804411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-256690d2-8d4e-4b97-8d7d-30d11b5f6bd1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.804862 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-256690d2-8d4e-4b97-8d7d-30d11b5f6bd1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.805287 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-256690d2-8d4e-4b97-8d7d-30d11b5f6bd1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.829892 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-256690d2-8d4e-4b97-8d7d-30d11b5f6bd1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Going to try to terminate instance {{(pid=126994) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:54:09.894508 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3ad32bfa-e4ed-4e2d-88cd-4ceaf8ea8ac3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:09.895140 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3ad32bfa-e4ed-4e2d-88cd-4ceaf8ea8ac3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:09.901391 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ad32bfa-e4ed-4e2d-88cd-4ceaf8ea8ac3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.901962 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ad32bfa-e4ed-4e2d-88cd-4ceaf8ea8ac3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.902547 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ad32bfa-e4ed-4e2d-88cd-4ceaf8ea8ac3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.903610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ad32bfa-e4ed-4e2d-88cd-4ceaf8ea8ac3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.904156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ad32bfa-e4ed-4e2d-88cd-4ceaf8ea8ac3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.904677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ad32bfa-e4ed-4e2d-88cd-4ceaf8ea8ac3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.909147 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-256690d2-8d4e-4b97-8d7d-30d11b5f6bd1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "DELETE /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 204 len: 0 microversion: 2.1 time: 0.117513 Aug 24 17:54:09.910031 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 347/665] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:54:09 2022] DELETE /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:54:09.919084 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e33c309a-8a59-476b-9ba5-aacf5d987a8c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:09.919846 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e33c309a-8a59-476b-9ba5-aacf5d987a8c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:09.927657 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e33c309a-8a59-476b-9ba5-aacf5d987a8c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.928572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e33c309a-8a59-476b-9ba5-aacf5d987a8c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.928572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e33c309a-8a59-476b-9ba5-aacf5d987a8c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.929284 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e33c309a-8a59-476b-9ba5-aacf5d987a8c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:09.929747 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e33c309a-8a59-476b-9ba5-aacf5d987a8c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:09.930175 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e33c309a-8a59-476b-9ba5-aacf5d987a8c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:09.947008 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:10.056614 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-3ad32bfa-e4ed-4e2d-88cd-4ceaf8ea8ac3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:10.064387 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-3ad32bfa-e4ed-4e2d-88cd-4ceaf8ea8ac3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1568 microversion: 2.1 time: 0.173814 Aug 24 17:54:10.064957 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 319/666] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:09 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:10.076291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e33c309a-8a59-476b-9ba5-aacf5d987a8c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:10.084628 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e33c309a-8a59-476b-9ba5-aacf5d987a8c tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1576 microversion: 2.1 time: 0.170171 Aug 24 17:54:10.085037 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c9ac2dd0-7eec-4334-a6f4-21043d31aac5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:10.085672 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 348/667] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:09 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:10.085810 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c9ac2dd0-7eec-4334-a6f4-21043d31aac5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:10.091770 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c9ac2dd0-7eec-4334-a6f4-21043d31aac5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:10.092261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c9ac2dd0-7eec-4334-a6f4-21043d31aac5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:10.093236 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c9ac2dd0-7eec-4334-a6f4-21043d31aac5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:10.093938 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c9ac2dd0-7eec-4334-a6f4-21043d31aac5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:10.094582 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c9ac2dd0-7eec-4334-a6f4-21043d31aac5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:10.095019 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c9ac2dd0-7eec-4334-a6f4-21043d31aac5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:10.136641 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c9ac2dd0-7eec-4334-a6f4-21043d31aac5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126993) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 17:54:10.200561 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c9ac2dd0-7eec-4334-a6f4-21043d31aac5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "POST /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d/action" status: 202 len: 0 microversion: 2.1 time: 0.119650 Aug 24 17:54:10.201113 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 320/668] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:54:10 2022] POST /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:54:10.210150 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b1c7c9dc-174d-47dc-b864-010dfe6ab5a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:10.210869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b1c7c9dc-174d-47dc-b864-010dfe6ab5a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:10.217467 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b1c7c9dc-174d-47dc-b864-010dfe6ab5a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:10.218632 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b1c7c9dc-174d-47dc-b864-010dfe6ab5a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:10.219129 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b1c7c9dc-174d-47dc-b864-010dfe6ab5a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:10.219914 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b1c7c9dc-174d-47dc-b864-010dfe6ab5a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:10.220431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b1c7c9dc-174d-47dc-b864-010dfe6ab5a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:10.220931 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b1c7c9dc-174d-47dc-b864-010dfe6ab5a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:10.397320 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b1c7c9dc-174d-47dc-b864-010dfe6ab5a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:10.406586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b1c7c9dc-174d-47dc-b864-010dfe6ab5a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1516 microversion: 2.1 time: 0.200535 Aug 24 17:54:10.407243 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 349/669] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:10 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1516 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:10.530791 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b2684da3-a345-47de-9787-bf9283cf6f0d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:10.531501 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b2684da3-a345-47de-9787-bf9283cf6f0d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:10.538156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2684da3-a345-47de-9787-bf9283cf6f0d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:10.538651 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2684da3-a345-47de-9787-bf9283cf6f0d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:10.539083 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2684da3-a345-47de-9787-bf9283cf6f0d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:10.539823 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2684da3-a345-47de-9787-bf9283cf6f0d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:10.540278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2684da3-a345-47de-9787-bf9283cf6f0d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:10.540702 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2684da3-a345-47de-9787-bf9283cf6f0d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:10.540807 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5fe2b02a-8fd4-4615-9a0e-8c31dc4c08e0 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:10.541479 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5fe2b02a-8fd4-4615-9a0e-8c31dc4c08e0 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:10.545027 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:10.549579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5fe2b02a-8fd4-4615-9a0e-8c31dc4c08e0 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:10.550375 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5fe2b02a-8fd4-4615-9a0e-8c31dc4c08e0 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:10.550884 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5fe2b02a-8fd4-4615-9a0e-8c31dc4c08e0 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:10.551707 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5fe2b02a-8fd4-4615-9a0e-8c31dc4c08e0 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:10.552256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5fe2b02a-8fd4-4615-9a0e-8c31dc4c08e0 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:10.552746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5fe2b02a-8fd4-4615-9a0e-8c31dc4c08e0 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:10.691448 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b2684da3-a345-47de-9787-bf9283cf6f0d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:10.700721 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b2684da3-a345-47de-9787-bf9283cf6f0d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:10.702842 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b2684da3-a345-47de-9787-bf9283cf6f0d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:10.704764 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b2684da3-a345-47de-9787-bf9283cf6f0d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1742 microversion: 2.20 time: 0.178409 Aug 24 17:54:10.706168 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 321/670] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:10 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:10.731042 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5fe2b02a-8fd4-4615-9a0e-8c31dc4c08e0 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:10.739446 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5fe2b02a-8fd4-4615-9a0e-8c31dc4c08e0 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1754 microversion: 2.1 time: 0.206503 Aug 24 17:54:10.740106 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 350/671] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:10 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1754 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:11.107000 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-dae4cbfb-0a51-4282-8dfb-5c21d124ce53 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:11.107581 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-dae4cbfb-0a51-4282-8dfb-5c21d124ce53 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:11.113566 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dae4cbfb-0a51-4282-8dfb-5c21d124ce53 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:11.114050 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dae4cbfb-0a51-4282-8dfb-5c21d124ce53 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:11.114490 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dae4cbfb-0a51-4282-8dfb-5c21d124ce53 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:11.115177 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dae4cbfb-0a51-4282-8dfb-5c21d124ce53 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:11.115705 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dae4cbfb-0a51-4282-8dfb-5c21d124ce53 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:11.116129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dae4cbfb-0a51-4282-8dfb-5c21d124ce53 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:11.255803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-dae4cbfb-0a51-4282-8dfb-5c21d124ce53 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:11.265373 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-dae4cbfb-0a51-4282-8dfb-5c21d124ce53 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1576 microversion: 2.1 time: 0.161695 Aug 24 17:54:11.265951 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 322/672] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:11 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:11.429842 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a914a3dc-be80-41fb-b0ab-28acf3f8dd2f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:11.431255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a914a3dc-be80-41fb-b0ab-28acf3f8dd2f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:11.441568 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a914a3dc-be80-41fb-b0ab-28acf3f8dd2f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:11.442434 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a914a3dc-be80-41fb-b0ab-28acf3f8dd2f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:11.443231 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a914a3dc-be80-41fb-b0ab-28acf3f8dd2f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:11.444518 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a914a3dc-be80-41fb-b0ab-28acf3f8dd2f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:11.445372 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a914a3dc-be80-41fb-b0ab-28acf3f8dd2f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:11.446131 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a914a3dc-be80-41fb-b0ab-28acf3f8dd2f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:11.551085 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-c4adf8a9-1cea-4140-b2c5-bb87af05b10d req-1f8f077e-3688-4cda-8ad1-cdaf412f0412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34147b78-b9f5-4566-8d38-f0ed7ef27e7f", "name": "network-vif-plugged", "status": "completed", "tag": "2ae11597-17eb-4280-8c34-d47ce491867b"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:11.564739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-c4adf8a9-1cea-4140-b2c5-bb87af05b10d req-1f8f077e-3688-4cda-8ad1-cdaf412f0412 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:11.565513 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-c4adf8a9-1cea-4140-b2c5-bb87af05b10d req-1f8f077e-3688-4cda-8ad1-cdaf412f0412 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:11.566226 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-c4adf8a9-1cea-4140-b2c5-bb87af05b10d req-1f8f077e-3688-4cda-8ad1-cdaf412f0412 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:11.579786 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-c4adf8a9-1cea-4140-b2c5-bb87af05b10d req-1f8f077e-3688-4cda-8ad1-cdaf412f0412 service nova] Creating event network-vif-plugged:2ae11597-17eb-4280-8c34-d47ce491867b for instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f on hv-cinder-84052 Aug 24 17:54:11.586196 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-c4adf8a9-1cea-4140-b2c5-bb87af05b10d req-1f8f077e-3688-4cda-8ad1-cdaf412f0412 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040175 Aug 24 17:54:11.587641 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 323/673] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:54:11.605368 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a914a3dc-be80-41fb-b0ab-28acf3f8dd2f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:11.614751 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a914a3dc-be80-41fb-b0ab-28acf3f8dd2f tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1518 microversion: 2.1 time: 0.190291 Aug 24 17:54:11.615667 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 351/674] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:11 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:11.730670 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-aef74bbd-9360-4f7f-8b62-70d923c18890 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:11.731382 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-aef74bbd-9360-4f7f-8b62-70d923c18890 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:11.737917 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-aef74bbd-9360-4f7f-8b62-70d923c18890 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:11.738408 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-aef74bbd-9360-4f7f-8b62-70d923c18890 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:11.738851 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-aef74bbd-9360-4f7f-8b62-70d923c18890 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:11.739584 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-aef74bbd-9360-4f7f-8b62-70d923c18890 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:11.740046 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-aef74bbd-9360-4f7f-8b62-70d923c18890 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:11.740469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-aef74bbd-9360-4f7f-8b62-70d923c18890 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:11.761335 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4e797ec3-919f-43ad-8ada-696ac8c58ce9 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:11.761955 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4e797ec3-919f-43ad-8ada-696ac8c58ce9 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:11.769818 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e797ec3-919f-43ad-8ada-696ac8c58ce9 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:11.770660 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e797ec3-919f-43ad-8ada-696ac8c58ce9 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:11.771302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e797ec3-919f-43ad-8ada-696ac8c58ce9 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:11.772319 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e797ec3-919f-43ad-8ada-696ac8c58ce9 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:11.772791 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e797ec3-919f-43ad-8ada-696ac8c58ce9 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:11.773414 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4e797ec3-919f-43ad-8ada-696ac8c58ce9 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:11.876315 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-aef74bbd-9360-4f7f-8b62-70d923c18890 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:11.884659 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-aef74bbd-9360-4f7f-8b62-70d923c18890 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:11.886162 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-aef74bbd-9360-4f7f-8b62-70d923c18890 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:11.887660 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-aef74bbd-9360-4f7f-8b62-70d923c18890 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1742 microversion: 2.20 time: 0.161621 Aug 24 17:54:11.888433 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 324/675] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:11 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:11.918841 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4e797ec3-919f-43ad-8ada-696ac8c58ce9 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:11.927756 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4e797ec3-919f-43ad-8ada-696ac8c58ce9 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1754 microversion: 2.1 time: 0.170360 Aug 24 17:54:11.928285 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 352/676] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:11 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:12.286650 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3ab39a43-055b-4ec7-9fba-db3c37f0ff34 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:12.287972 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3ab39a43-055b-4ec7-9fba-db3c37f0ff34 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:12.294103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ab39a43-055b-4ec7-9fba-db3c37f0ff34 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:12.294796 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ab39a43-055b-4ec7-9fba-db3c37f0ff34 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:12.295388 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ab39a43-055b-4ec7-9fba-db3c37f0ff34 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:12.296339 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ab39a43-055b-4ec7-9fba-db3c37f0ff34 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:12.296951 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ab39a43-055b-4ec7-9fba-db3c37f0ff34 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:12.297751 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ab39a43-055b-4ec7-9fba-db3c37f0ff34 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:12.523371 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-3ab39a43-055b-4ec7-9fba-db3c37f0ff34 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:12.530840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-3ab39a43-055b-4ec7-9fba-db3c37f0ff34 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1576 microversion: 2.1 time: 0.248654 Aug 24 17:54:12.531676 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 325/677] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:12 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1576 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:12.637331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-443806bd-f686-47f8-a864-74391d9e0047 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:12.637697 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-443806bd-f686-47f8-a864-74391d9e0047 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:12.645833 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-443806bd-f686-47f8-a864-74391d9e0047 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:12.647999 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-443806bd-f686-47f8-a864-74391d9e0047 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:12.648598 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-443806bd-f686-47f8-a864-74391d9e0047 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:12.650298 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-443806bd-f686-47f8-a864-74391d9e0047 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:12.651277 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-443806bd-f686-47f8-a864-74391d9e0047 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:12.651932 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-443806bd-f686-47f8-a864-74391d9e0047 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:12.810493 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-443806bd-f686-47f8-a864-74391d9e0047 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:12.819124 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-443806bd-f686-47f8-a864-74391d9e0047 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.185982 Aug 24 17:54:12.820131 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 353/678] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:12 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:12.911161 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-580bdef0-3fe5-440b-a08e-20c5aa07972b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:12.912718 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-580bdef0-3fe5-440b-a08e-20c5aa07972b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:12.921379 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-580bdef0-3fe5-440b-a08e-20c5aa07972b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:12.922012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-580bdef0-3fe5-440b-a08e-20c5aa07972b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:12.922587 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-580bdef0-3fe5-440b-a08e-20c5aa07972b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:12.923388 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-580bdef0-3fe5-440b-a08e-20c5aa07972b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:12.923966 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-580bdef0-3fe5-440b-a08e-20c5aa07972b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:12.924492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-580bdef0-3fe5-440b-a08e-20c5aa07972b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:12.950087 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b06aba6f-a97c-45b5-92d8-799b59943447 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:12.950958 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b06aba6f-a97c-45b5-92d8-799b59943447 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:12.957896 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b06aba6f-a97c-45b5-92d8-799b59943447 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:12.958504 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b06aba6f-a97c-45b5-92d8-799b59943447 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:12.958937 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b06aba6f-a97c-45b5-92d8-799b59943447 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:12.959701 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b06aba6f-a97c-45b5-92d8-799b59943447 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:12.960150 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b06aba6f-a97c-45b5-92d8-799b59943447 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:12.960594 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b06aba6f-a97c-45b5-92d8-799b59943447 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:13.219881 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-580bdef0-3fe5-440b-a08e-20c5aa07972b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:13.224142 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b06aba6f-a97c-45b5-92d8-799b59943447 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:13.234541 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b06aba6f-a97c-45b5-92d8-799b59943447 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1754 microversion: 2.1 time: 0.288593 Aug 24 17:54:13.235919 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 354/679] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:12 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1754 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:13.239348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-580bdef0-3fe5-440b-a08e-20c5aa07972b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:13.241631 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-580bdef0-3fe5-440b-a08e-20c5aa07972b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:13.242924 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-580bdef0-3fe5-440b-a08e-20c5aa07972b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1737 microversion: 2.20 time: 0.335716 Aug 24 17:54:13.243882 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 326/680] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:12 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1737 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:13.552245 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b47eb083-bd76-4fa2-b421-f7f35ed5217e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:13.552853 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b47eb083-bd76-4fa2-b421-f7f35ed5217e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:13.558856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b47eb083-bd76-4fa2-b421-f7f35ed5217e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:13.559519 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b47eb083-bd76-4fa2-b421-f7f35ed5217e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:13.559960 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b47eb083-bd76-4fa2-b421-f7f35ed5217e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:13.560655 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b47eb083-bd76-4fa2-b421-f7f35ed5217e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:13.561107 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b47eb083-bd76-4fa2-b421-f7f35ed5217e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:13.562066 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b47eb083-bd76-4fa2-b421-f7f35ed5217e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:13.633408 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-97de4e02-f5c3-4826-abee-b414ab11a417 req-594a3878-23da-4a37-8cf7-7f83a1dc8ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b47b8e-315b-4035-b274-e3d90094cea0", "name": "network-vif-deleted", "tag": "685b75ea-eb05-4e07-8542-1938a960343d"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:13.649400 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-97de4e02-f5c3-4826-abee-b414ab11a417 req-594a3878-23da-4a37-8cf7-7f83a1dc8ff8 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:13.650246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-97de4e02-f5c3-4826-abee-b414ab11a417 req-594a3878-23da-4a37-8cf7-7f83a1dc8ff8 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:13.650879 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-97de4e02-f5c3-4826-abee-b414ab11a417 req-594a3878-23da-4a37-8cf7-7f83a1dc8ff8 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:13.659634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b47eb083-bd76-4fa2-b421-f7f35ed5217e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:13.669020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b47eb083-bd76-4fa2-b421-f7f35ed5217e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 200 len: 1508 microversion: 2.1 time: 0.120428 Aug 24 17:54:13.677677 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 355/681] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:13 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 1508 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:13.685443 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-97de4e02-f5c3-4826-abee-b414ab11a417 req-594a3878-23da-4a37-8cf7-7f83a1dc8ff8 service nova] Creating event network-vif-deleted:685b75ea-eb05-4e07-8542-1938a960343d for instance 33b47b8e-315b-4035-b274-e3d90094cea0 on hv-cinder-84052 Aug 24 17:54:13.698097 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-97de4e02-f5c3-4826-abee-b414ab11a417 req-594a3878-23da-4a37-8cf7-7f83a1dc8ff8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067700 Aug 24 17:54:13.700390 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 327/682] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:13.783675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-cd5a351b-2888-455a-b4ea-a3cebd10203e req-d06b6fea-8006-4f7e-aef3-d79b3367a4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa859353-b309-4c9b-8f43-21b185b4f27d", "name": "network-vif-unplugged", "status": "completed", "tag": "8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:13.794984 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-cd5a351b-2888-455a-b4ea-a3cebd10203e req-d06b6fea-8006-4f7e-aef3-d79b3367a4f3 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:13.796535 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-cd5a351b-2888-455a-b4ea-a3cebd10203e req-d06b6fea-8006-4f7e-aef3-d79b3367a4f3 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:13.797216 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-cd5a351b-2888-455a-b4ea-a3cebd10203e req-d06b6fea-8006-4f7e-aef3-d79b3367a4f3 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:13.811808 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-cd5a351b-2888-455a-b4ea-a3cebd10203e req-d06b6fea-8006-4f7e-aef3-d79b3367a4f3 service nova] Creating event network-vif-unplugged:8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba for instance aa859353-b309-4c9b-8f43-21b185b4f27d on hv-cinder-84052 Aug 24 17:54:13.817292 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-cd5a351b-2888-455a-b4ea-a3cebd10203e req-d06b6fea-8006-4f7e-aef3-d79b3367a4f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039216 Aug 24 17:54:13.818190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 356/683] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:13.840644 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-034a02b4-7eae-41e1-9722-b852b5967156 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:13.842279 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-034a02b4-7eae-41e1-9722-b852b5967156 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:13.855834 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-034a02b4-7eae-41e1-9722-b852b5967156 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:13.856711 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-034a02b4-7eae-41e1-9722-b852b5967156 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:13.859525 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-034a02b4-7eae-41e1-9722-b852b5967156 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:13.860788 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-034a02b4-7eae-41e1-9722-b852b5967156 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:13.861351 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-034a02b4-7eae-41e1-9722-b852b5967156 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:13.864093 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-034a02b4-7eae-41e1-9722-b852b5967156 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:14.162266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-034a02b4-7eae-41e1-9722-b852b5967156 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:14.173996 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-034a02b4-7eae-41e1-9722-b852b5967156 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.337515 Aug 24 17:54:14.175543 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 328/684] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:13 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:14.260746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f933c7bc-598e-4ad4-93a2-5b479255ceb5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:14.261807 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f933c7bc-598e-4ad4-93a2-5b479255ceb5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:14.269295 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f933c7bc-598e-4ad4-93a2-5b479255ceb5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:14.270039 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f933c7bc-598e-4ad4-93a2-5b479255ceb5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:14.270636 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f933c7bc-598e-4ad4-93a2-5b479255ceb5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:14.271523 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f933c7bc-598e-4ad4-93a2-5b479255ceb5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:14.272132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f933c7bc-598e-4ad4-93a2-5b479255ceb5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:14.272837 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-51f2e448-6ed1-4ea9-8420-8d8a2993a3cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:14.273126 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f933c7bc-598e-4ad4-93a2-5b479255ceb5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:14.273459 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-51f2e448-6ed1-4ea9-8420-8d8a2993a3cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:14.282255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-51f2e448-6ed1-4ea9-8420-8d8a2993a3cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:14.282749 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-51f2e448-6ed1-4ea9-8420-8d8a2993a3cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:14.283193 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-51f2e448-6ed1-4ea9-8420-8d8a2993a3cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:14.284954 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-51f2e448-6ed1-4ea9-8420-8d8a2993a3cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:14.285419 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-51f2e448-6ed1-4ea9-8420-8d8a2993a3cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:14.286694 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-51f2e448-6ed1-4ea9-8420-8d8a2993a3cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:14.485009 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f933c7bc-598e-4ad4-93a2-5b479255ceb5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:14.494503 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f933c7bc-598e-4ad4-93a2-5b479255ceb5 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1754 microversion: 2.1 time: 0.238006 Aug 24 17:54:14.508884 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 357/685] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:14 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1754 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:14.520453 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-51f2e448-6ed1-4ea9-8420-8d8a2993a3cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:14.534452 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-51f2e448-6ed1-4ea9-8420-8d8a2993a3cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:14.536381 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-51f2e448-6ed1-4ea9-8420-8d8a2993a3cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:14.537891 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-51f2e448-6ed1-4ea9-8420-8d8a2993a3cb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1737 microversion: 2.20 time: 0.268808 Aug 24 17:54:14.538933 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 329/686] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:14 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:54:14.701135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9114b5cf-f2e4-44a2-b32e-c5978da7badc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:14.703079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9114b5cf-f2e4-44a2-b32e-c5978da7badc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:14.710176 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:14.712099 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9114b5cf-f2e4-44a2-b32e-c5978da7badc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:14.712759 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9114b5cf-f2e4-44a2-b32e-c5978da7badc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:14.713198 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9114b5cf-f2e4-44a2-b32e-c5978da7badc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:14.713904 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9114b5cf-f2e4-44a2-b32e-c5978da7badc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:14.714362 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9114b5cf-f2e4-44a2-b32e-c5978da7badc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:14.714781 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9114b5cf-f2e4-44a2-b32e-c5978da7badc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:14.733213 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-9114b5cf-f2e4-44a2-b32e-c5978da7badc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] HTTP exception thrown: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9114b5cf-f2e4-44a2-b32e-c5978da7badc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Request method failure captured: Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 HTTP/1.1 Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmUBWkfrS8ZGkmyQEOGi6Laer1EmDuN36spPyhpJLIaExnRNcpyr9WwfeQ_2ljIiYQnap_XPjj-n_0rVdH6C-CVYneD-6jeB7hEDt4A8XyL6P_x0LTfOYUQmKjNApcsoBIPsipNHs5DdFHSTa6DFNh1m3J8Koy9sTSNziiox3P8Suo4 Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: b9cd3cd0a9434f5ab0e1e1c52145beb2 Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-TestVolumeBootPattern-298645184 Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:54:14.735015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:54:14.736616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}] Aug 24 17:54:14.736616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-TestVolumeBootPattern-298645184 Aug 24 17:54:14.736616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: b9cd3cd0a9434f5ab0e1e1c52145beb2 Aug 24 17:54:14.736616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-TestVolumeBootPattern-298645184 Aug 24 17:54:14.736616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-TestVolumeBootPattern-298645184-project Aug 24 17:54:14.736616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:54:14.736616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:54:14.736616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 4279761de1464be38860432a46a89074 Aug 24 17:54:14.736616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-TestVolumeBootPattern-298645184-project Aug 24 17:54:14.736616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:54:14.736616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:54:14.736616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '33b47b8e-315b-4035-b274-e3d90094cea0'} Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:54:14.737466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:54:14.740210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:54:14.742183 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9114b5cf-f2e4-44a2-b32e-c5978da7badc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Returning 404 to user: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:54:14.742183 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9114b5cf-f2e4-44a2-b32e-c5978da7badc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 404 len: 111 microversion: 2.1 time: 0.039578 Aug 24 17:54:14.742183 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 358/687] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:14 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:54:14.852671 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1778905730", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1899728589", "security_groups": [{"name": "tempest-secgroup-smoke-1035260104"}], "block_device_mapping_v2": [{"uuid": "f98aa1e4-b578-4c01-af7a-83866f47c27c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "670b2ce6-025e-49c8-81a1-b5bd33c90dee"}]}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:15.041039 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] validate_networks() for [('670b2ce6-025e-49c8-81a1-b5bd33c90dee', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:54:15.201219 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-16479f88-8a59-4d72-a0b1-bbde56d3861c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:15.202504 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-16479f88-8a59-4d72-a0b1-bbde56d3861c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:15.209251 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16479f88-8a59-4d72-a0b1-bbde56d3861c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:15.218569 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16479f88-8a59-4d72-a0b1-bbde56d3861c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:15.219189 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16479f88-8a59-4d72-a0b1-bbde56d3861c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:15.220080 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16479f88-8a59-4d72-a0b1-bbde56d3861c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:15.220678 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16479f88-8a59-4d72-a0b1-bbde56d3861c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:15.221218 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-16479f88-8a59-4d72-a0b1-bbde56d3861c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:15.414788 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-16479f88-8a59-4d72-a0b1-bbde56d3861c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:15.425463 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-16479f88-8a59-4d72-a0b1-bbde56d3861c tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.228573 Aug 24 17:54:15.426710 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 359/688] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:15 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:15.521128 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-841c2420-3fa3-433b-bcb9-5ad456b33375 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:15.522136 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-841c2420-3fa3-433b-bcb9-5ad456b33375 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:15.537202 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-841c2420-3fa3-433b-bcb9-5ad456b33375 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:15.538189 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-841c2420-3fa3-433b-bcb9-5ad456b33375 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:15.538801 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-841c2420-3fa3-433b-bcb9-5ad456b33375 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:15.539710 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-841c2420-3fa3-433b-bcb9-5ad456b33375 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:15.539836 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:54:15.540311 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:54:15.540575 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:54:15.541111 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-841c2420-3fa3-433b-bcb9-5ad456b33375 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:15.541338 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:54:15.541705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-841c2420-3fa3-433b-bcb9-5ad456b33375 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:15.542191 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:54:15.547325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:15.554279 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:15.554752 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:15.556399 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:15.557410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:15.558029 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:15.558613 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:15.582095 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Getting quotas for project b9cd3cd0a9434f5ab0e1e1c52145beb2. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:54:15.590084 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Getting quotas for user 4279761de1464be38860432a46a89074 and project b9cd3cd0a9434f5ab0e1e1c52145beb2. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:54:15.667402 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:54:15.670071 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f98aa1e4-b578-4c01-af7a-83866f47c27c',volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:54:15.761290 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-841c2420-3fa3-433b-bcb9-5ad456b33375 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:15.774364 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-841c2420-3fa3-433b-bcb9-5ad456b33375 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1754 microversion: 2.1 time: 0.262455 Aug 24 17:54:15.779646 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 360/689] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:15 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1754 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:15.784524 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-32362e73-80de-4f99-8538-51f688775d26 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:15.785329 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-32362e73-80de-4f99-8538-51f688775d26 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:15.793845 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-32362e73-80de-4f99-8538-51f688775d26 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:15.794894 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-32362e73-80de-4f99-8538-51f688775d26 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:15.795284 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-32362e73-80de-4f99-8538-51f688775d26 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:15.796542 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-32362e73-80de-4f99-8538-51f688775d26 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:15.797345 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-32362e73-80de-4f99-8538-51f688775d26 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:15.798208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-32362e73-80de-4f99-8538-51f688775d26 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:15.841004 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1a3a3da0-5ce1-4cc2-9fa2-f6e3b3cbedcd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.992795 Aug 24 17:54:15.842211 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 330/690] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:54:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:54:15.852971 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-94aa989f-ecdb-4c30-82eb-0f94423b4668 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:15.853676 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-94aa989f-ecdb-4c30-82eb-0f94423b4668 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:15.928000 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-94aa989f-ecdb-4c30-82eb-0f94423b4668 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:15.943687 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-94aa989f-ecdb-4c30-82eb-0f94423b4668 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1095 microversion: 2.1 time: 0.094748 Aug 24 17:54:15.944947 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 331/691] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:15 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1095 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:16.034469 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-32362e73-80de-4f99-8538-51f688775d26 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:16.046264 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-32362e73-80de-4f99-8538-51f688775d26 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:16.051977 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-32362e73-80de-4f99-8538-51f688775d26 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:16.053157 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-32362e73-80de-4f99-8538-51f688775d26 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1737 microversion: 2.20 time: 0.276531 Aug 24 17:54:16.053698 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 361/692] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:15 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1737 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:16.453956 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-de3e9b91-b458-4ccb-a8f1-7268f2b04f90 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:16.454587 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-de3e9b91-b458-4ccb-a8f1-7268f2b04f90 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:16.461236 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de3e9b91-b458-4ccb-a8f1-7268f2b04f90 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:16.461729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de3e9b91-b458-4ccb-a8f1-7268f2b04f90 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:16.462163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de3e9b91-b458-4ccb-a8f1-7268f2b04f90 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:16.462875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de3e9b91-b458-4ccb-a8f1-7268f2b04f90 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:16.464999 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de3e9b91-b458-4ccb-a8f1-7268f2b04f90 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:16.465678 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-de3e9b91-b458-4ccb-a8f1-7268f2b04f90 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:16.675915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-de3e9b91-b458-4ccb-a8f1-7268f2b04f90 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:16.691125 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-de3e9b91-b458-4ccb-a8f1-7268f2b04f90 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.247741 Aug 24 17:54:16.692212 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 332/693] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:16 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:16.795690 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-39a5e9d8-6c4b-4e2e-a339-757552c3a1e3 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:16.796305 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-39a5e9d8-6c4b-4e2e-a339-757552c3a1e3 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:16.803290 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-39a5e9d8-6c4b-4e2e-a339-757552c3a1e3 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:16.803817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-39a5e9d8-6c4b-4e2e-a339-757552c3a1e3 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:16.804457 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-39a5e9d8-6c4b-4e2e-a339-757552c3a1e3 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:16.805340 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-39a5e9d8-6c4b-4e2e-a339-757552c3a1e3 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:16.805953 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-39a5e9d8-6c4b-4e2e-a339-757552c3a1e3 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:16.806381 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-39a5e9d8-6c4b-4e2e-a339-757552c3a1e3 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:16.969398 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b43c63a6-dd55-48e7-bab7-6e4ba2ba29e0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:16.970030 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b43c63a6-dd55-48e7-bab7-6e4ba2ba29e0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:16.981705 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b43c63a6-dd55-48e7-bab7-6e4ba2ba29e0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:16.982188 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b43c63a6-dd55-48e7-bab7-6e4ba2ba29e0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:16.982621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b43c63a6-dd55-48e7-bab7-6e4ba2ba29e0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:16.983351 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b43c63a6-dd55-48e7-bab7-6e4ba2ba29e0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:16.983828 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b43c63a6-dd55-48e7-bab7-6e4ba2ba29e0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:16.984245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b43c63a6-dd55-48e7-bab7-6e4ba2ba29e0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:16.991637 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-39a5e9d8-6c4b-4e2e-a339-757552c3a1e3 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:17.000318 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-39a5e9d8-6c4b-4e2e-a339-757552c3a1e3 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1754 microversion: 2.1 time: 0.208464 Aug 24 17:54:17.011293 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 362/694] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:16 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1754 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:17.083538 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d1c339c7-cb3b-42c6-a50e-c74d7b6a116d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:17.084541 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d1c339c7-cb3b-42c6-a50e-c74d7b6a116d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:17.099918 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d1c339c7-cb3b-42c6-a50e-c74d7b6a116d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:17.100166 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b43c63a6-dd55-48e7-bab7-6e4ba2ba29e0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:17.101999 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d1c339c7-cb3b-42c6-a50e-c74d7b6a116d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:17.102750 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d1c339c7-cb3b-42c6-a50e-c74d7b6a116d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:17.104608 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d1c339c7-cb3b-42c6-a50e-c74d7b6a116d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:17.105569 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d1c339c7-cb3b-42c6-a50e-c74d7b6a116d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:17.106434 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d1c339c7-cb3b-42c6-a50e-c74d7b6a116d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:17.119715 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b43c63a6-dd55-48e7-bab7-6e4ba2ba29e0 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1193 microversion: 2.1 time: 0.154992 Aug 24 17:54:17.138444 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 333/695] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:16 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1193 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:17.286850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d1c339c7-cb3b-42c6-a50e-c74d7b6a116d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:17.300104 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d1c339c7-cb3b-42c6-a50e-c74d7b6a116d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:17.301628 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d1c339c7-cb3b-42c6-a50e-c74d7b6a116d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:17.302800 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d1c339c7-cb3b-42c6-a50e-c74d7b6a116d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1737 microversion: 2.20 time: 0.224282 Aug 24 17:54:17.316349 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 363/696] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:17 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:54:17.717672 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2ac3bc21-8d1f-43f2-a9b6-6696d40a55da tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:17.718942 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2ac3bc21-8d1f-43f2-a9b6-6696d40a55da tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:17.730227 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc21-8d1f-43f2-a9b6-6696d40a55da tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:17.732130 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc21-8d1f-43f2-a9b6-6696d40a55da tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:17.735779 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc21-8d1f-43f2-a9b6-6696d40a55da tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:17.736751 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc21-8d1f-43f2-a9b6-6696d40a55da tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:17.737386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc21-8d1f-43f2-a9b6-6696d40a55da tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:17.737996 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2ac3bc21-8d1f-43f2-a9b6-6696d40a55da tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:18.001286 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2ac3bc21-8d1f-43f2-a9b6-6696d40a55da tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:18.015710 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2ac3bc21-8d1f-43f2-a9b6-6696d40a55da tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.306143 Aug 24 17:54:18.018397 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 334/697] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:17 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:18.035288 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f4d4754a-e535-4cbd-a2a9-368fb8098312 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:18.035956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f4d4754a-e535-4cbd-a2a9-368fb8098312 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:18.047797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f4d4754a-e535-4cbd-a2a9-368fb8098312 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:18.048100 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f4d4754a-e535-4cbd-a2a9-368fb8098312 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:18.049280 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f4d4754a-e535-4cbd-a2a9-368fb8098312 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:18.052325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f4d4754a-e535-4cbd-a2a9-368fb8098312 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:18.054175 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f4d4754a-e535-4cbd-a2a9-368fb8098312 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:18.054175 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f4d4754a-e535-4cbd-a2a9-368fb8098312 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:18.141906 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-766e02b4-1367-47ca-af28-338a44216acc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:18.142630 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-766e02b4-1367-47ca-af28-338a44216acc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:18.149741 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-766e02b4-1367-47ca-af28-338a44216acc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:18.150045 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-766e02b4-1367-47ca-af28-338a44216acc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:18.150547 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-766e02b4-1367-47ca-af28-338a44216acc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:18.151404 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-766e02b4-1367-47ca-af28-338a44216acc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:18.154503 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-766e02b4-1367-47ca-af28-338a44216acc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:18.155607 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-766e02b4-1367-47ca-af28-338a44216acc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:18.419759 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f4d4754a-e535-4cbd-a2a9-368fb8098312 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:18.429656 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f4d4754a-e535-4cbd-a2a9-368fb8098312 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1757 microversion: 2.1 time: 0.398122 Aug 24 17:54:18.432165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 364/698] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:18 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1757 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:18.441183 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-65123776-f506-4863-854e-a13b9de6cffe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:18.446715 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-65123776-f506-4863-854e-a13b9de6cffe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:18.459400 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-65123776-f506-4863-854e-a13b9de6cffe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:18.460159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-65123776-f506-4863-854e-a13b9de6cffe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:18.460762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-65123776-f506-4863-854e-a13b9de6cffe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:18.461711 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-65123776-f506-4863-854e-a13b9de6cffe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:18.462316 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-65123776-f506-4863-854e-a13b9de6cffe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:18.463352 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-65123776-f506-4863-854e-a13b9de6cffe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:18.483508 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-766e02b4-1367-47ca-af28-338a44216acc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:18.493901 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-766e02b4-1367-47ca-af28-338a44216acc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1279 microversion: 2.1 time: 0.355836 Aug 24 17:54:18.494690 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 335/699] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:18 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1279 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:18.908678 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-65123776-f506-4863-854e-a13b9de6cffe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:18.921011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-65123776-f506-4863-854e-a13b9de6cffe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:18.922523 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-65123776-f506-4863-854e-a13b9de6cffe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:18.923728 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-65123776-f506-4863-854e-a13b9de6cffe tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1737 microversion: 2.20 time: 0.490428 Aug 24 17:54:18.924473 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 365/700] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:18 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1737 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:19.042622 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8a4ab98f-8e37-4fbd-a4cb-cf2c7d822079 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:19.043210 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8a4ab98f-8e37-4fbd-a4cb-cf2c7d822079 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:19.053810 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a4ab98f-8e37-4fbd-a4cb-cf2c7d822079 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.054312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a4ab98f-8e37-4fbd-a4cb-cf2c7d822079 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.054755 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a4ab98f-8e37-4fbd-a4cb-cf2c7d822079 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.055473 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a4ab98f-8e37-4fbd-a4cb-cf2c7d822079 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.055975 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a4ab98f-8e37-4fbd-a4cb-cf2c7d822079 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.056403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a4ab98f-8e37-4fbd-a4cb-cf2c7d822079 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.151716 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-57ba81ff-26c0-49fb-bffd-a5f146cd7f6e req-41c2f5fc-1641-4246-808f-20398e2fce6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38237468-6ade-46a7-830f-371a8a34c4f4", "tag": "68a6e936-3e2e-4bc2-ab59-de0b96e000d7"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:19.177198 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-57ba81ff-26c0-49fb-bffd-a5f146cd7f6e req-41c2f5fc-1641-4246-808f-20398e2fce6a service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.177698 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-57ba81ff-26c0-49fb-bffd-a5f146cd7f6e req-41c2f5fc-1641-4246-808f-20398e2fce6a service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.178130 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-57ba81ff-26c0-49fb-bffd-a5f146cd7f6e req-41c2f5fc-1641-4246-808f-20398e2fce6a service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.196469 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-57ba81ff-26c0-49fb-bffd-a5f146cd7f6e req-41c2f5fc-1641-4246-808f-20398e2fce6a service nova] Creating event network-changed:68a6e936-3e2e-4bc2-ab59-de0b96e000d7 for instance 38237468-6ade-46a7-830f-371a8a34c4f4 on hv-cinder-84052 Aug 24 17:54:19.202617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-57ba81ff-26c0-49fb-bffd-a5f146cd7f6e req-41c2f5fc-1641-4246-808f-20398e2fce6a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053888 Aug 24 17:54:19.204005 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 366/701] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:54:19.310767 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8a4ab98f-8e37-4fbd-a4cb-cf2c7d822079 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:19.321084 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8a4ab98f-8e37-4fbd-a4cb-cf2c7d822079 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.283057 Aug 24 17:54:19.322039 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 336/702] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:19 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:19.515703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f5dae525-6bd4-4e58-83e9-2ada9e01c29b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:19.516888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f5dae525-6bd4-4e58-83e9-2ada9e01c29b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:19.524008 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f5dae525-6bd4-4e58-83e9-2ada9e01c29b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.524480 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f5dae525-6bd4-4e58-83e9-2ada9e01c29b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.524998 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f5dae525-6bd4-4e58-83e9-2ada9e01c29b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.525800 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f5dae525-6bd4-4e58-83e9-2ada9e01c29b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.526519 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f5dae525-6bd4-4e58-83e9-2ada9e01c29b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.527182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f5dae525-6bd4-4e58-83e9-2ada9e01c29b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.530815 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=100 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:19.713535 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f5dae525-6bd4-4e58-83e9-2ada9e01c29b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:19.721941 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f5dae525-6bd4-4e58-83e9-2ada9e01c29b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.211119 Aug 24 17:54:19.722589 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 367/703] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:19 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:19.946339 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4faf7b35-c984-4f83-b831-ec792522ab43 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:19.951914 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4faf7b35-c984-4f83-b831-ec792522ab43 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:19.958988 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4faf7b35-c984-4f83-b831-ec792522ab43 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.959624 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4faf7b35-c984-4f83-b831-ec792522ab43 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.960132 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4faf7b35-c984-4f83-b831-ec792522ab43 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:19.961090 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4faf7b35-c984-4f83-b831-ec792522ab43 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:19.961634 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4faf7b35-c984-4f83-b831-ec792522ab43 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:19.962129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4faf7b35-c984-4f83-b831-ec792522ab43 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:20.127535 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4faf7b35-c984-4f83-b831-ec792522ab43 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:20.136506 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4faf7b35-c984-4f83-b831-ec792522ab43 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:20.138396 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4faf7b35-c984-4f83-b831-ec792522ab43 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:20.141122 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4faf7b35-c984-4f83-b831-ec792522ab43 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1737 microversion: 2.20 time: 0.198582 Aug 24 17:54:20.142869 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 337/704] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:19 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:20.345974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1b102010-ffba-4f50-acde-7132ecf0dc26 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:20.346895 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1b102010-ffba-4f50-acde-7132ecf0dc26 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:20.355916 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1b102010-ffba-4f50-acde-7132ecf0dc26 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:20.356779 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1b102010-ffba-4f50-acde-7132ecf0dc26 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:20.358276 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1b102010-ffba-4f50-acde-7132ecf0dc26 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:20.359298 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1b102010-ffba-4f50-acde-7132ecf0dc26 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:20.359937 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1b102010-ffba-4f50-acde-7132ecf0dc26 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:20.360521 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1b102010-ffba-4f50-acde-7132ecf0dc26 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:20.540330 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1b102010-ffba-4f50-acde-7132ecf0dc26 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:20.549407 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1b102010-ffba-4f50-acde-7132ecf0dc26 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.207979 Aug 24 17:54:20.563240 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 368/705] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:20 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:20.744379 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-093711b5-90e1-4b28-8fa7-be9590b59954 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:20.745105 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-093711b5-90e1-4b28-8fa7-be9590b59954 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:20.754352 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-093711b5-90e1-4b28-8fa7-be9590b59954 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:20.755445 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-093711b5-90e1-4b28-8fa7-be9590b59954 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:20.756186 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-093711b5-90e1-4b28-8fa7-be9590b59954 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:20.757501 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-093711b5-90e1-4b28-8fa7-be9590b59954 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:20.758044 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-093711b5-90e1-4b28-8fa7-be9590b59954 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:20.758688 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-093711b5-90e1-4b28-8fa7-be9590b59954 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:21.030638 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-093711b5-90e1-4b28-8fa7-be9590b59954 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:21.048112 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-093711b5-90e1-4b28-8fa7-be9590b59954 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.307556 Aug 24 17:54:21.049185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 338/706] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:20 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:21.166665 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6664adfd-b4d4-4896-9a84-12bef3fdc87d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:21.167754 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-6664adfd-b4d4-4896-9a84-12bef3fdc87d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:21.176258 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6664adfd-b4d4-4896-9a84-12bef3fdc87d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:21.177149 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6664adfd-b4d4-4896-9a84-12bef3fdc87d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:21.177823 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6664adfd-b4d4-4896-9a84-12bef3fdc87d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:21.179647 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6664adfd-b4d4-4896-9a84-12bef3fdc87d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:21.180374 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6664adfd-b4d4-4896-9a84-12bef3fdc87d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:21.181042 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-6664adfd-b4d4-4896-9a84-12bef3fdc87d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:21.353607 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6664adfd-b4d4-4896-9a84-12bef3fdc87d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:21.362563 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6664adfd-b4d4-4896-9a84-12bef3fdc87d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:21.365817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-6664adfd-b4d4-4896-9a84-12bef3fdc87d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:21.367299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6664adfd-b4d4-4896-9a84-12bef3fdc87d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1737 microversion: 2.20 time: 0.205668 Aug 24 17:54:21.368439 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 369/707] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:21 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:21.570512 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ede0e309-66d8-45d4-a2e2-f0dceeb4ea72 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:21.571830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ede0e309-66d8-45d4-a2e2-f0dceeb4ea72 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:21.579980 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ede0e309-66d8-45d4-a2e2-f0dceeb4ea72 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:21.581128 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ede0e309-66d8-45d4-a2e2-f0dceeb4ea72 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:21.581849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ede0e309-66d8-45d4-a2e2-f0dceeb4ea72 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:21.582648 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ede0e309-66d8-45d4-a2e2-f0dceeb4ea72 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:21.583252 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ede0e309-66d8-45d4-a2e2-f0dceeb4ea72 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:21.583921 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ede0e309-66d8-45d4-a2e2-f0dceeb4ea72 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:21.728217 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ede0e309-66d8-45d4-a2e2-f0dceeb4ea72 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:21.739428 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ede0e309-66d8-45d4-a2e2-f0dceeb4ea72 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.173042 Aug 24 17:54:21.751613 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 339/708] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:21 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:22.069212 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-96a458ba-c0c6-4d08-9ca1-d5bcd5e13ccd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:22.069831 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-96a458ba-c0c6-4d08-9ca1-d5bcd5e13ccd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:22.078424 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96a458ba-c0c6-4d08-9ca1-d5bcd5e13ccd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:22.078912 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96a458ba-c0c6-4d08-9ca1-d5bcd5e13ccd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:22.079357 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96a458ba-c0c6-4d08-9ca1-d5bcd5e13ccd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:22.080073 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96a458ba-c0c6-4d08-9ca1-d5bcd5e13ccd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:22.080948 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96a458ba-c0c6-4d08-9ca1-d5bcd5e13ccd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:22.084211 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96a458ba-c0c6-4d08-9ca1-d5bcd5e13ccd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:22.237070 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-96a458ba-c0c6-4d08-9ca1-d5bcd5e13ccd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:22.246306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-96a458ba-c0c6-4d08-9ca1-d5bcd5e13ccd tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.180761 Aug 24 17:54:22.247123 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 370/709] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:22 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:22.393176 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-17a9bc6b-df20-48f8-996d-9d27cda3f330 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:22.393789 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-17a9bc6b-df20-48f8-996d-9d27cda3f330 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:22.399858 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-17a9bc6b-df20-48f8-996d-9d27cda3f330 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:22.400343 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-17a9bc6b-df20-48f8-996d-9d27cda3f330 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:22.400777 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-17a9bc6b-df20-48f8-996d-9d27cda3f330 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:22.401467 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-17a9bc6b-df20-48f8-996d-9d27cda3f330 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:22.401926 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-17a9bc6b-df20-48f8-996d-9d27cda3f330 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:22.402349 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-17a9bc6b-df20-48f8-996d-9d27cda3f330 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:22.548336 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-17a9bc6b-df20-48f8-996d-9d27cda3f330 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:22.550590 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=100 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:22.558557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-17a9bc6b-df20-48f8-996d-9d27cda3f330 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:22.560097 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-17a9bc6b-df20-48f8-996d-9d27cda3f330 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:22.561944 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-17a9bc6b-df20-48f8-996d-9d27cda3f330 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1737 microversion: 2.20 time: 0.172699 Aug 24 17:54:22.576129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 340/710] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:22 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:22.763980 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-218bd14f-d3ac-4eed-9120-1c8d0a0478a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:22.766631 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-218bd14f-d3ac-4eed-9120-1c8d0a0478a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:22.774546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-218bd14f-d3ac-4eed-9120-1c8d0a0478a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:22.775231 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-218bd14f-d3ac-4eed-9120-1c8d0a0478a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:22.775662 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-218bd14f-d3ac-4eed-9120-1c8d0a0478a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:22.776373 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-218bd14f-d3ac-4eed-9120-1c8d0a0478a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:22.777006 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-218bd14f-d3ac-4eed-9120-1c8d0a0478a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:22.777600 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-218bd14f-d3ac-4eed-9120-1c8d0a0478a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:22.921657 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-218bd14f-d3ac-4eed-9120-1c8d0a0478a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:22.929836 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-218bd14f-d3ac-4eed-9120-1c8d0a0478a3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.169955 Aug 24 17:54:22.943138 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 371/711] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:22 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:23.267662 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6beaa7ad-df1c-4f2a-8706-333498e35b03 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:23.268202 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6beaa7ad-df1c-4f2a-8706-333498e35b03 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:23.274650 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6beaa7ad-df1c-4f2a-8706-333498e35b03 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:23.275136 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6beaa7ad-df1c-4f2a-8706-333498e35b03 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:23.275598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6beaa7ad-df1c-4f2a-8706-333498e35b03 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:23.276288 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6beaa7ad-df1c-4f2a-8706-333498e35b03 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:23.276791 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6beaa7ad-df1c-4f2a-8706-333498e35b03 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:23.277165 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6beaa7ad-df1c-4f2a-8706-333498e35b03 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:23.407998 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6beaa7ad-df1c-4f2a-8706-333498e35b03 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:23.415975 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6beaa7ad-df1c-4f2a-8706-333498e35b03 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.152238 Aug 24 17:54:23.416631 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 341/712] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:23 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:23.586768 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0fe7ac81-f2a9-4a55-bf76-509ee72451f7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:23.587391 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0fe7ac81-f2a9-4a55-bf76-509ee72451f7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:23.595355 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0fe7ac81-f2a9-4a55-bf76-509ee72451f7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:23.595886 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0fe7ac81-f2a9-4a55-bf76-509ee72451f7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:23.596328 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0fe7ac81-f2a9-4a55-bf76-509ee72451f7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:23.597032 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0fe7ac81-f2a9-4a55-bf76-509ee72451f7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:23.597491 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0fe7ac81-f2a9-4a55-bf76-509ee72451f7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:23.597940 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0fe7ac81-f2a9-4a55-bf76-509ee72451f7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:23.727873 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0fe7ac81-f2a9-4a55-bf76-509ee72451f7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:23.736522 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0fe7ac81-f2a9-4a55-bf76-509ee72451f7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:23.738102 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0fe7ac81-f2a9-4a55-bf76-509ee72451f7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:23.739324 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0fe7ac81-f2a9-4a55-bf76-509ee72451f7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1719 microversion: 2.20 time: 0.156726 Aug 24 17:54:23.740168 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 372/713] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:23 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:23.950918 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-cf2963ca-11fd-4cc3-965a-c51996ffeae3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:23.952260 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-cf2963ca-11fd-4cc3-965a-c51996ffeae3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:23.958852 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cf2963ca-11fd-4cc3-965a-c51996ffeae3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:23.959349 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cf2963ca-11fd-4cc3-965a-c51996ffeae3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:23.959843 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cf2963ca-11fd-4cc3-965a-c51996ffeae3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:23.960556 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cf2963ca-11fd-4cc3-965a-c51996ffeae3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:23.961010 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cf2963ca-11fd-4cc3-965a-c51996ffeae3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:23.961437 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cf2963ca-11fd-4cc3-965a-c51996ffeae3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:24.167951 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-cf2963ca-11fd-4cc3-965a-c51996ffeae3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:24.176070 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-cf2963ca-11fd-4cc3-965a-c51996ffeae3 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.228948 Aug 24 17:54:24.176648 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 342/714] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:23 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:24.438049 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b906d704-e4ad-45d6-851b-0021a420adaa tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:24.438597 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b906d704-e4ad-45d6-851b-0021a420adaa tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:24.444585 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b906d704-e4ad-45d6-851b-0021a420adaa tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:24.445069 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b906d704-e4ad-45d6-851b-0021a420adaa tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:24.445504 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b906d704-e4ad-45d6-851b-0021a420adaa tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:24.446190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b906d704-e4ad-45d6-851b-0021a420adaa tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:24.446642 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b906d704-e4ad-45d6-851b-0021a420adaa tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:24.447064 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b906d704-e4ad-45d6-851b-0021a420adaa tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:24.579746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b906d704-e4ad-45d6-851b-0021a420adaa tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:24.587710 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b906d704-e4ad-45d6-851b-0021a420adaa tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.154207 Aug 24 17:54:24.588270 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 373/715] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:24 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:24.762190 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-944aacb0-3a03-4e85-969e-834c06c1cfd9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:24.762814 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-944aacb0-3a03-4e85-969e-834c06c1cfd9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:24.769757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-944aacb0-3a03-4e85-969e-834c06c1cfd9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:24.770229 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-944aacb0-3a03-4e85-969e-834c06c1cfd9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:24.770655 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-944aacb0-3a03-4e85-969e-834c06c1cfd9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:24.771331 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-944aacb0-3a03-4e85-969e-834c06c1cfd9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:24.771877 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-944aacb0-3a03-4e85-969e-834c06c1cfd9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:24.772291 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-944aacb0-3a03-4e85-969e-834c06c1cfd9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:24.899561 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-944aacb0-3a03-4e85-969e-834c06c1cfd9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:24.907852 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-944aacb0-3a03-4e85-969e-834c06c1cfd9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:24.909306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-944aacb0-3a03-4e85-969e-834c06c1cfd9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:24.910482 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-944aacb0-3a03-4e85-969e-834c06c1cfd9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1719 microversion: 2.20 time: 0.152133 Aug 24 17:54:24.915542 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 343/716] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:24 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:25.197766 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-663d24d7-7c2d-49cd-9579-1d237fc1ffb8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:25.198379 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-663d24d7-7c2d-49cd-9579-1d237fc1ffb8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:25.204697 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-663d24d7-7c2d-49cd-9579-1d237fc1ffb8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:25.205436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-663d24d7-7c2d-49cd-9579-1d237fc1ffb8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:25.205866 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-663d24d7-7c2d-49cd-9579-1d237fc1ffb8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.206546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-663d24d7-7c2d-49cd-9579-1d237fc1ffb8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:25.207002 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-663d24d7-7c2d-49cd-9579-1d237fc1ffb8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:25.207422 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-663d24d7-7c2d-49cd-9579-1d237fc1ffb8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.335591 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-663d24d7-7c2d-49cd-9579-1d237fc1ffb8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:25.343237 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-663d24d7-7c2d-49cd-9579-1d237fc1ffb8 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.149321 Aug 24 17:54:25.343857 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 374/717] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:25 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:25.582545 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-2de8cf36-87c1-42eb-9005-8b0f18d2a1cb req-f0a94d66-5258-4d22-a1ac-310b451ed51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa859353-b309-4c9b-8f43-21b185b4f27d", "name": "network-vif-plugged", "status": "completed", "tag": "8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:25.587557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:25.594439 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-2de8cf36-87c1-42eb-9005-8b0f18d2a1cb req-f0a94d66-5258-4d22-a1ac-310b451ed51f service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:25.594914 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-2de8cf36-87c1-42eb-9005-8b0f18d2a1cb req-f0a94d66-5258-4d22-a1ac-310b451ed51f service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:25.595355 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-2de8cf36-87c1-42eb-9005-8b0f18d2a1cb req-f0a94d66-5258-4d22-a1ac-310b451ed51f service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.607167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-2de8cf36-87c1-42eb-9005-8b0f18d2a1cb req-f0a94d66-5258-4d22-a1ac-310b451ed51f service nova] Creating event network-vif-plugged:8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba for instance aa859353-b309-4c9b-8f43-21b185b4f27d on hv-cinder-84052 Aug 24 17:54:25.610000 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c5ab03eb-aee2-4ed1-8d9d-6e8d29a35884 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:25.611207 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c5ab03eb-aee2-4ed1-8d9d-6e8d29a35884 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:25.612740 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-2de8cf36-87c1-42eb-9005-8b0f18d2a1cb req-f0a94d66-5258-4d22-a1ac-310b451ed51f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034112 Aug 24 17:54:25.613526 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 344/718] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:25.617719 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c5ab03eb-aee2-4ed1-8d9d-6e8d29a35884 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:25.618212 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c5ab03eb-aee2-4ed1-8d9d-6e8d29a35884 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:25.618656 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c5ab03eb-aee2-4ed1-8d9d-6e8d29a35884 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.619409 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c5ab03eb-aee2-4ed1-8d9d-6e8d29a35884 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:25.619909 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c5ab03eb-aee2-4ed1-8d9d-6e8d29a35884 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:25.620323 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c5ab03eb-aee2-4ed1-8d9d-6e8d29a35884 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.762656 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c5ab03eb-aee2-4ed1-8d9d-6e8d29a35884 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:25.770418 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c5ab03eb-aee2-4ed1-8d9d-6e8d29a35884 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.165765 Aug 24 17:54:25.770991 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 375/719] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:25 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:25.934022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4e56d383-4da1-4b11-8d69-a4540818d4d2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:25.934748 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4e56d383-4da1-4b11-8d69-a4540818d4d2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:25.941489 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4e56d383-4da1-4b11-8d69-a4540818d4d2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:25.941912 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4e56d383-4da1-4b11-8d69-a4540818d4d2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:25.942349 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4e56d383-4da1-4b11-8d69-a4540818d4d2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.943038 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4e56d383-4da1-4b11-8d69-a4540818d4d2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:25.943518 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4e56d383-4da1-4b11-8d69-a4540818d4d2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:25.943944 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4e56d383-4da1-4b11-8d69-a4540818d4d2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:25.944457 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=8 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:26.075544 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4e56d383-4da1-4b11-8d69-a4540818d4d2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:26.084514 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4e56d383-4da1-4b11-8d69-a4540818d4d2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:26.086006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4e56d383-4da1-4b11-8d69-a4540818d4d2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:26.087166 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4e56d383-4da1-4b11-8d69-a4540818d4d2 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1719 microversion: 2.20 time: 0.157428 Aug 24 17:54:26.087770 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 345/720] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:25 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:26.363916 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-87ae8e2f-dd5d-472b-8fc0-2e1734f7283e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:26.364536 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-87ae8e2f-dd5d-472b-8fc0-2e1734f7283e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:26.371148 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-87ae8e2f-dd5d-472b-8fc0-2e1734f7283e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:26.371833 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-87ae8e2f-dd5d-472b-8fc0-2e1734f7283e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:26.372332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-87ae8e2f-dd5d-472b-8fc0-2e1734f7283e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:26.373032 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-87ae8e2f-dd5d-472b-8fc0-2e1734f7283e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:26.374015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-87ae8e2f-dd5d-472b-8fc0-2e1734f7283e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:26.374465 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-87ae8e2f-dd5d-472b-8fc0-2e1734f7283e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:26.504411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-87ae8e2f-dd5d-472b-8fc0-2e1734f7283e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:26.512148 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-87ae8e2f-dd5d-472b-8fc0-2e1734f7283e tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.152154 Aug 24 17:54:26.512710 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 376/721] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:26 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:26.848792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-192baaf0-a734-4f1d-851d-431a5024a3e5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:26.849328 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-192baaf0-a734-4f1d-851d-431a5024a3e5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:26.855323 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-192baaf0-a734-4f1d-851d-431a5024a3e5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:26.855836 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-192baaf0-a734-4f1d-851d-431a5024a3e5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:26.856259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-192baaf0-a734-4f1d-851d-431a5024a3e5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:26.856941 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-192baaf0-a734-4f1d-851d-431a5024a3e5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:26.857388 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-192baaf0-a734-4f1d-851d-431a5024a3e5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:26.857801 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-192baaf0-a734-4f1d-851d-431a5024a3e5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:26.991207 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-192baaf0-a734-4f1d-851d-431a5024a3e5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:26.999837 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-192baaf0-a734-4f1d-851d-431a5024a3e5 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.154906 Aug 24 17:54:27.000422 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 346/722] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:26 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:27.110371 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5f901393-c987-452b-b2ab-89b8309f9903 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:27.110917 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5f901393-c987-452b-b2ab-89b8309f9903 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:27.117313 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5f901393-c987-452b-b2ab-89b8309f9903 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:27.117801 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5f901393-c987-452b-b2ab-89b8309f9903 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:27.118238 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5f901393-c987-452b-b2ab-89b8309f9903 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:27.118931 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5f901393-c987-452b-b2ab-89b8309f9903 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:27.119391 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5f901393-c987-452b-b2ab-89b8309f9903 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:27.119867 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5f901393-c987-452b-b2ab-89b8309f9903 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:27.250986 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5f901393-c987-452b-b2ab-89b8309f9903 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:27.259176 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5f901393-c987-452b-b2ab-89b8309f9903 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:27.260707 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5f901393-c987-452b-b2ab-89b8309f9903 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:27.261851 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5f901393-c987-452b-b2ab-89b8309f9903 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1662 microversion: 2.20 time: 0.155609 Aug 24 17:54:27.262399 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 377/723] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:27 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:27.284805 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-33580733-02fc-4164-b9df-864e255f14ca tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21db704a-b5a4-44a5-9506-8f771d3fe69c"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:27.287174 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-33580733-02fc-4164-b9df-864e255f14ca tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:27.293118 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-33580733-02fc-4164-b9df-864e255f14ca tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:27.293603 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-33580733-02fc-4164-b9df-864e255f14ca tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:27.294041 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-33580733-02fc-4164-b9df-864e255f14ca tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:27.294733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-33580733-02fc-4164-b9df-864e255f14ca tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:27.295193 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-33580733-02fc-4164-b9df-864e255f14ca tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:27.296270 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-33580733-02fc-4164-b9df-864e255f14ca tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:27.536892 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c340f38c-ae61-43f9-baca-0873cee31f04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:27.537633 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c340f38c-ae61-43f9-baca-0873cee31f04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:27.544314 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c340f38c-ae61-43f9-baca-0873cee31f04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:27.544897 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c340f38c-ae61-43f9-baca-0873cee31f04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:27.545415 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c340f38c-ae61-43f9-baca-0873cee31f04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:27.546178 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c340f38c-ae61-43f9-baca-0873cee31f04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:27.546743 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c340f38c-ae61-43f9-baca-0873cee31f04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:27.547234 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c340f38c-ae61-43f9-baca-0873cee31f04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:27.584454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-33580733-02fc-4164-b9df-864e255f14ca tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "POST /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304047 Aug 24 17:54:27.585198 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 347/724] 10.222.0.27 () {62 vars in 1364 bytes} [Wed Aug 24 17:54:27 2022] POST /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 17:54:27.643017 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-a9bdf936-9577-4694-a2e0-2732296e0c0c req-7780196b-1a2a-4c46-9b04-9042c46c19a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34147b78-b9f5-4566-8d38-f0ed7ef27e7f", "name": "network-vif-unplugged", "status": "completed", "tag": "2ae11597-17eb-4280-8c34-d47ce491867b"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:27.654143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-a9bdf936-9577-4694-a2e0-2732296e0c0c req-7780196b-1a2a-4c46-9b04-9042c46c19a9 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:27.654624 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-a9bdf936-9577-4694-a2e0-2732296e0c0c req-7780196b-1a2a-4c46-9b04-9042c46c19a9 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:27.655669 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-a9bdf936-9577-4694-a2e0-2732296e0c0c req-7780196b-1a2a-4c46-9b04-9042c46c19a9 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:27.666249 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.compute.server_external_events [req-a9bdf936-9577-4694-a2e0-2732296e0c0c req-7780196b-1a2a-4c46-9b04-9042c46c19a9 service nova] Unable to find a host for instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f. Dropping event network-vif-unplugged {{(pid=126993) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 17:54:27.667127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-a9bdf936-9577-4694-a2e0-2732296e0c0c req-7780196b-1a2a-4c46-9b04-9042c46c19a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036389 Aug 24 17:54:27.667913 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 348/725] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 17:54:27.693434 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c340f38c-ae61-43f9-baca-0873cee31f04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:27.701146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c340f38c-ae61-43f9-baca-0873cee31f04 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1574 microversion: 2.1 time: 0.168144 Aug 24 17:54:27.701698 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 378/726] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:27 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:27.709166 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-13dc7bce-eab2-4b98-9cf9-c62c3140fd63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:27.709736 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-13dc7bce-eab2-4b98-9cf9-c62c3140fd63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:27.715879 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-13dc7bce-eab2-4b98-9cf9-c62c3140fd63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:27.716369 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-13dc7bce-eab2-4b98-9cf9-c62c3140fd63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:27.716781 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-13dc7bce-eab2-4b98-9cf9-c62c3140fd63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:27.718003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-13dc7bce-eab2-4b98-9cf9-c62c3140fd63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:27.718464 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-13dc7bce-eab2-4b98-9cf9-c62c3140fd63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:27.718883 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-13dc7bce-eab2-4b98-9cf9-c62c3140fd63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:27.940655 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-13dc7bce-eab2-4b98-9cf9-c62c3140fd63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "DELETE /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/os-volume_attachments/21db704a-b5a4-44a5-9506-8f771d3fe69c" status: 202 len: 0 microversion: 2.20 time: 0.235643 Aug 24 17:54:27.941230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 349/727] 10.222.0.27 () {60 vars in 1457 bytes} [Wed Aug 24 17:54:27 2022] DELETE /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/os-volume_attachments/21db704a-b5a4-44a5-9506-8f771d3fe69c => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:54:27.998458 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e76476cb-38cc-43b0-a033-6d027356292f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:27.999579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e76476cb-38cc-43b0-a033-6d027356292f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:28.005334 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e76476cb-38cc-43b0-a033-6d027356292f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:28.005806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e76476cb-38cc-43b0-a033-6d027356292f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:28.006233 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e76476cb-38cc-43b0-a033-6d027356292f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:28.006905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e76476cb-38cc-43b0-a033-6d027356292f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:28.007353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e76476cb-38cc-43b0-a033-6d027356292f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:28.007800 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e76476cb-38cc-43b0-a033-6d027356292f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:28.021328 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0e7bd39b-38a0-4919-a82d-7139443881d2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:28.021950 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0e7bd39b-38a0-4919-a82d-7139443881d2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:28.027872 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e7bd39b-38a0-4919-a82d-7139443881d2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:28.028357 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e7bd39b-38a0-4919-a82d-7139443881d2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:28.028792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e7bd39b-38a0-4919-a82d-7139443881d2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:28.029484 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e7bd39b-38a0-4919-a82d-7139443881d2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:28.029942 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e7bd39b-38a0-4919-a82d-7139443881d2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:28.030365 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e7bd39b-38a0-4919-a82d-7139443881d2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:28.037232 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e76476cb-38cc-43b0-a033-6d027356292f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126994) unshelve /opt/stack/nova/nova/compute/api.py:4589}} Aug 24 17:54:28.104863 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e76476cb-38cc-43b0-a033-6d027356292f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [ab5d367e-039b-4b95-b7f7-1a96d76e075c] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 17:54:28.171851 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0e7bd39b-38a0-4919-a82d-7139443881d2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:28.179447 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0e7bd39b-38a0-4919-a82d-7139443881d2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.162148 Aug 24 17:54:28.180040 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 350/728] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:28 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:28.722690 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e3ffd5bc-0fde-4e92-a5af-0797974b0c85 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:28.723306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e3ffd5bc-0fde-4e92-a5af-0797974b0c85 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:28.729808 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e3ffd5bc-0fde-4e92-a5af-0797974b0c85 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:28.730289 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e3ffd5bc-0fde-4e92-a5af-0797974b0c85 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:28.730723 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e3ffd5bc-0fde-4e92-a5af-0797974b0c85 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:28.731414 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e3ffd5bc-0fde-4e92-a5af-0797974b0c85 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:28.731894 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e3ffd5bc-0fde-4e92-a5af-0797974b0c85 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:28.732318 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e3ffd5bc-0fde-4e92-a5af-0797974b0c85 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:28.860434 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e3ffd5bc-0fde-4e92-a5af-0797974b0c85 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:28.868220 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e3ffd5bc-0fde-4e92-a5af-0797974b0c85 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1561 microversion: 2.1 time: 0.149470 Aug 24 17:54:28.868783 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 351/729] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:28 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:29.112285 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO oslo.messaging._drivers.impl_rabbit [None req-e76476cb-38cc-43b0-a033-6d027356292f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [ab5d367e-039b-4b95-b7f7-1a96d76e075c] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 42476. Aug 24 17:54:29.115386 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e76476cb-38cc-43b0-a033-6d027356292f tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "POST /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/action" status: 202 len: 0 microversion: 2.20 time: 1.120834 Aug 24 17:54:29.116023 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 379/730] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Aug 24 17:54:27 2022] POST /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/action => generated 0 bytes in 1122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:54:29.123875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f2d5bcc5-da58-43cf-b4cb-2b71b66d2bff tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:29.124610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f2d5bcc5-da58-43cf-b4cb-2b71b66d2bff tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:29.130701 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2d5bcc5-da58-43cf-b4cb-2b71b66d2bff tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:29.131188 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2d5bcc5-da58-43cf-b4cb-2b71b66d2bff tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:29.131647 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2d5bcc5-da58-43cf-b4cb-2b71b66d2bff tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:29.132345 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2d5bcc5-da58-43cf-b4cb-2b71b66d2bff tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:29.132792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2d5bcc5-da58-43cf-b4cb-2b71b66d2bff tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:29.133205 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2d5bcc5-da58-43cf-b4cb-2b71b66d2bff tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:29.200621 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-56a75d66-a2de-458e-b256-9c9658ece6ef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:29.201526 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-56a75d66-a2de-458e-b256-9c9658ece6ef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:29.208432 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-56a75d66-a2de-458e-b256-9c9658ece6ef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:29.208923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-56a75d66-a2de-458e-b256-9c9658ece6ef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:29.209359 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-56a75d66-a2de-458e-b256-9c9658ece6ef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:29.210250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-56a75d66-a2de-458e-b256-9c9658ece6ef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:29.210704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-56a75d66-a2de-458e-b256-9c9658ece6ef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:29.211428 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-56a75d66-a2de-458e-b256-9c9658ece6ef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:29.270831 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f2d5bcc5-da58-43cf-b4cb-2b71b66d2bff tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:29.279425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f2d5bcc5-da58-43cf-b4cb-2b71b66d2bff tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:29.281531 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f2d5bcc5-da58-43cf-b4cb-2b71b66d2bff tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:29.283689 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-f2d5bcc5-da58-43cf-b4cb-2b71b66d2bff tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1670 microversion: 2.20 time: 0.163075 Aug 24 17:54:29.284368 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 352/731] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:29 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:29.353855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-56a75d66-a2de-458e-b256-9c9658ece6ef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:29.362824 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-56a75d66-a2de-458e-b256-9c9658ece6ef tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.166133 Aug 24 17:54:29.363645 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 380/732] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:29 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:30.306093 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-35047466-bbcd-4e5f-baf0-ec7fef487beb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:30.306920 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-35047466-bbcd-4e5f-baf0-ec7fef487beb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:30.314094 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-35047466-bbcd-4e5f-baf0-ec7fef487beb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:30.314573 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-35047466-bbcd-4e5f-baf0-ec7fef487beb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:30.315072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-35047466-bbcd-4e5f-baf0-ec7fef487beb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:30.315848 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-35047466-bbcd-4e5f-baf0-ec7fef487beb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:30.316294 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-35047466-bbcd-4e5f-baf0-ec7fef487beb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:30.316710 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-35047466-bbcd-4e5f-baf0-ec7fef487beb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:30.335550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:30.383576 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-57080596-1799-40ae-97c6-e1e3c0829755 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:30.384308 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-57080596-1799-40ae-97c6-e1e3c0829755 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:30.390606 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-57080596-1799-40ae-97c6-e1e3c0829755 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:30.391081 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-57080596-1799-40ae-97c6-e1e3c0829755 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:30.391534 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-57080596-1799-40ae-97c6-e1e3c0829755 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:30.392221 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-57080596-1799-40ae-97c6-e1e3c0829755 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:30.392670 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-57080596-1799-40ae-97c6-e1e3c0829755 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:30.393120 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-57080596-1799-40ae-97c6-e1e3c0829755 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:30.535706 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-35047466-bbcd-4e5f-baf0-ec7fef487beb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:30.535888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-57080596-1799-40ae-97c6-e1e3c0829755 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:30.544315 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-57080596-1799-40ae-97c6-e1e3c0829755 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.164651 Aug 24 17:54:30.544507 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-35047466-bbcd-4e5f-baf0-ec7fef487beb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:30.545088 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 381/733] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:30 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:30.546708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-35047466-bbcd-4e5f-baf0-ec7fef487beb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:30.547893 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-35047466-bbcd-4e5f-baf0-ec7fef487beb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.245625 Aug 24 17:54:30.556678 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 353/734] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:30 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:31.572611 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e280eb53-99d0-4e00-b977-401cf9eeb085 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:31.574017 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e280eb53-99d0-4e00-b977-401cf9eeb085 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:31.577848 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9e62a557-9c56-4ec5-a35a-9ef54c084196 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:31.579549 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9e62a557-9c56-4ec5-a35a-9ef54c084196 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:31.583650 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e280eb53-99d0-4e00-b977-401cf9eeb085 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:31.584438 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e280eb53-99d0-4e00-b977-401cf9eeb085 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:31.585129 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e280eb53-99d0-4e00-b977-401cf9eeb085 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:31.586195 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e280eb53-99d0-4e00-b977-401cf9eeb085 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:31.586937 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e280eb53-99d0-4e00-b977-401cf9eeb085 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:31.587751 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e280eb53-99d0-4e00-b977-401cf9eeb085 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:31.593164 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9e62a557-9c56-4ec5-a35a-9ef54c084196 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:31.594032 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9e62a557-9c56-4ec5-a35a-9ef54c084196 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:31.594728 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9e62a557-9c56-4ec5-a35a-9ef54c084196 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:31.595712 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9e62a557-9c56-4ec5-a35a-9ef54c084196 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:31.596365 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9e62a557-9c56-4ec5-a35a-9ef54c084196 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:31.597016 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9e62a557-9c56-4ec5-a35a-9ef54c084196 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:31.789561 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9e62a557-9c56-4ec5-a35a-9ef54c084196 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:31.798106 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9e62a557-9c56-4ec5-a35a-9ef54c084196 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.225377 Aug 24 17:54:31.823956 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 354/735] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:31 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:31.828941 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e280eb53-99d0-4e00-b977-401cf9eeb085 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:31.831797 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-dcd8ae2b-5c8c-4acb-9922-5a6849539122 req-9a1cd927-d7a6-4440-ba98-32b500fbcd2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38237468-6ade-46a7-830f-371a8a34c4f4", "name": "network-vif-plugged", "status": "completed", "tag": "68a6e936-3e2e-4bc2-ab59-de0b96e000d7"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:31.836376 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:31.840264 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e280eb53-99d0-4e00-b977-401cf9eeb085 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:31.842233 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e280eb53-99d0-4e00-b977-401cf9eeb085 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:31.843897 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e280eb53-99d0-4e00-b977-401cf9eeb085 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.275172 Aug 24 17:54:31.844250 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-dcd8ae2b-5c8c-4acb-9922-5a6849539122 req-9a1cd927-d7a6-4440-ba98-32b500fbcd2c service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:31.844823 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-dcd8ae2b-5c8c-4acb-9922-5a6849539122 req-9a1cd927-d7a6-4440-ba98-32b500fbcd2c service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:31.845225 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 382/736] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:31 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:31.845884 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-dcd8ae2b-5c8c-4acb-9922-5a6849539122 req-9a1cd927-d7a6-4440-ba98-32b500fbcd2c service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:31.859440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-dcd8ae2b-5c8c-4acb-9922-5a6849539122 req-9a1cd927-d7a6-4440-ba98-32b500fbcd2c service nova] Creating event network-vif-plugged:68a6e936-3e2e-4bc2-ab59-de0b96e000d7 for instance 38237468-6ade-46a7-830f-371a8a34c4f4 on hv-cinder-84052 Aug 24 17:54:31.865637 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-dcd8ae2b-5c8c-4acb-9922-5a6849539122 req-9a1cd927-d7a6-4440-ba98-32b500fbcd2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039523 Aug 24 17:54:31.867279 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 355/737] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:32.821789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-aa16d0bd-c2e5-4dc4-b7e0-4ccf566a9308 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:32.822313 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-aa16d0bd-c2e5-4dc4-b7e0-4ccf566a9308 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:32.830706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aa16d0bd-c2e5-4dc4-b7e0-4ccf566a9308 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:32.831211 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aa16d0bd-c2e5-4dc4-b7e0-4ccf566a9308 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:32.831673 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aa16d0bd-c2e5-4dc4-b7e0-4ccf566a9308 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:32.832549 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aa16d0bd-c2e5-4dc4-b7e0-4ccf566a9308 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:32.833172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aa16d0bd-c2e5-4dc4-b7e0-4ccf566a9308 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:32.833597 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aa16d0bd-c2e5-4dc4-b7e0-4ccf566a9308 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:32.868288 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c01c11dc-a69a-4fc0-b311-4156cfa69ad9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:32.868986 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c01c11dc-a69a-4fc0-b311-4156cfa69ad9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:32.876155 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c01c11dc-a69a-4fc0-b311-4156cfa69ad9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:32.876641 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c01c11dc-a69a-4fc0-b311-4156cfa69ad9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:32.877098 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c01c11dc-a69a-4fc0-b311-4156cfa69ad9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:32.877842 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c01c11dc-a69a-4fc0-b311-4156cfa69ad9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:32.878310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c01c11dc-a69a-4fc0-b311-4156cfa69ad9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:32.878734 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c01c11dc-a69a-4fc0-b311-4156cfa69ad9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:32.974956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-aa16d0bd-c2e5-4dc4-b7e0-4ccf566a9308 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:32.986035 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-aa16d0bd-c2e5-4dc4-b7e0-4ccf566a9308 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.168051 Aug 24 17:54:32.986626 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 383/738] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:32 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:33.042486 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c01c11dc-a69a-4fc0-b311-4156cfa69ad9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:33.051044 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c01c11dc-a69a-4fc0-b311-4156cfa69ad9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:33.052778 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c01c11dc-a69a-4fc0-b311-4156cfa69ad9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:33.054024 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c01c11dc-a69a-4fc0-b311-4156cfa69ad9 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.190420 Aug 24 17:54:33.055157 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 356/739] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:32 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:54:34.007637 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-600938c2-1361-43be-a9e4-59ef7a1d8c5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:34.008506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-600938c2-1361-43be-a9e4-59ef7a1d8c5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:34.015663 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-600938c2-1361-43be-a9e4-59ef7a1d8c5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:34.016225 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-600938c2-1361-43be-a9e4-59ef7a1d8c5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:34.016923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-600938c2-1361-43be-a9e4-59ef7a1d8c5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:34.017852 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-600938c2-1361-43be-a9e4-59ef7a1d8c5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:34.018662 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-600938c2-1361-43be-a9e4-59ef7a1d8c5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:34.019301 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-600938c2-1361-43be-a9e4-59ef7a1d8c5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:34.079258 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-925bac3b-718c-4ec9-bfed-2d5de05b57fb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:34.081328 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-925bac3b-718c-4ec9-bfed-2d5de05b57fb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:34.100925 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-925bac3b-718c-4ec9-bfed-2d5de05b57fb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:34.101425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-925bac3b-718c-4ec9-bfed-2d5de05b57fb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:34.101970 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-925bac3b-718c-4ec9-bfed-2d5de05b57fb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:34.103031 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-925bac3b-718c-4ec9-bfed-2d5de05b57fb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:34.103272 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-925bac3b-718c-4ec9-bfed-2d5de05b57fb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:34.103869 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-925bac3b-718c-4ec9-bfed-2d5de05b57fb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:34.168776 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-600938c2-1361-43be-a9e4-59ef7a1d8c5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:34.177404 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-600938c2-1361-43be-a9e4-59ef7a1d8c5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.173538 Aug 24 17:54:34.178292 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 384/740] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:34 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:34.262026 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-925bac3b-718c-4ec9-bfed-2d5de05b57fb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:34.271131 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-925bac3b-718c-4ec9-bfed-2d5de05b57fb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:34.272769 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-925bac3b-718c-4ec9-bfed-2d5de05b57fb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:34.274013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-925bac3b-718c-4ec9-bfed-2d5de05b57fb tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.200012 Aug 24 17:54:34.274930 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 357/741] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:34 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:54:35.198158 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-edc3cdd9-0cc0-4ef3-ac2b-0b7ad9c25362 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:35.199509 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-edc3cdd9-0cc0-4ef3-ac2b-0b7ad9c25362 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:35.206983 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-edc3cdd9-0cc0-4ef3-ac2b-0b7ad9c25362 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:35.207516 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-edc3cdd9-0cc0-4ef3-ac2b-0b7ad9c25362 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:35.208175 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-edc3cdd9-0cc0-4ef3-ac2b-0b7ad9c25362 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:35.208934 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-edc3cdd9-0cc0-4ef3-ac2b-0b7ad9c25362 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:35.209460 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-edc3cdd9-0cc0-4ef3-ac2b-0b7ad9c25362 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:35.209910 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-edc3cdd9-0cc0-4ef3-ac2b-0b7ad9c25362 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:35.297342 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-57f24526-f9f1-4d1c-82c2-468ec4d14fcf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:35.297954 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-57f24526-f9f1-4d1c-82c2-468ec4d14fcf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:35.304631 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-57f24526-f9f1-4d1c-82c2-468ec4d14fcf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:35.305122 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-57f24526-f9f1-4d1c-82c2-468ec4d14fcf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:35.305552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-57f24526-f9f1-4d1c-82c2-468ec4d14fcf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:35.306245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-57f24526-f9f1-4d1c-82c2-468ec4d14fcf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:35.306768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-57f24526-f9f1-4d1c-82c2-468ec4d14fcf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:35.307106 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-57f24526-f9f1-4d1c-82c2-468ec4d14fcf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:35.353271 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-edc3cdd9-0cc0-4ef3-ac2b-0b7ad9c25362 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:35.361115 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-edc3cdd9-0cc0-4ef3-ac2b-0b7ad9c25362 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.166746 Aug 24 17:54:35.361685 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 385/742] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:35 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:35.455198 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-57f24526-f9f1-4d1c-82c2-468ec4d14fcf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:35.464271 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-57f24526-f9f1-4d1c-82c2-468ec4d14fcf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:35.466058 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-57f24526-f9f1-4d1c-82c2-468ec4d14fcf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:35.467728 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-57f24526-f9f1-4d1c-82c2-468ec4d14fcf tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.174548 Aug 24 17:54:35.468286 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 358/743] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:35 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:36.382207 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c2f6d7b5-513e-4b70-894e-0a4cda2a693e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:36.382887 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c2f6d7b5-513e-4b70-894e-0a4cda2a693e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:36.389482 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c2f6d7b5-513e-4b70-894e-0a4cda2a693e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:36.389981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c2f6d7b5-513e-4b70-894e-0a4cda2a693e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:36.390437 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c2f6d7b5-513e-4b70-894e-0a4cda2a693e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:36.391855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c2f6d7b5-513e-4b70-894e-0a4cda2a693e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:36.392318 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c2f6d7b5-513e-4b70-894e-0a4cda2a693e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:36.392746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c2f6d7b5-513e-4b70-894e-0a4cda2a693e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:36.491058 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-fd78d141-3ed6-4877-8dcc-efeaed86cab3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:36.492750 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-fd78d141-3ed6-4877-8dcc-efeaed86cab3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:36.500756 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd78d141-3ed6-4877-8dcc-efeaed86cab3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:36.501596 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd78d141-3ed6-4877-8dcc-efeaed86cab3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:36.502268 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd78d141-3ed6-4877-8dcc-efeaed86cab3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:36.503193 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd78d141-3ed6-4877-8dcc-efeaed86cab3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:36.503888 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd78d141-3ed6-4877-8dcc-efeaed86cab3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:36.504533 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd78d141-3ed6-4877-8dcc-efeaed86cab3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:36.540669 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c2f6d7b5-513e-4b70-894e-0a4cda2a693e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:36.557282 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c2f6d7b5-513e-4b70-894e-0a4cda2a693e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.178821 Aug 24 17:54:36.558840 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 386/744] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:36 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:36.660500 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-fd78d141-3ed6-4877-8dcc-efeaed86cab3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:36.670102 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-fd78d141-3ed6-4877-8dcc-efeaed86cab3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:36.671649 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-fd78d141-3ed6-4877-8dcc-efeaed86cab3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:36.673413 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-fd78d141-3ed6-4877-8dcc-efeaed86cab3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.186484 Aug 24 17:54:36.673969 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 359/745] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:36 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:37.578988 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-41886fed-8839-4e80-8165-3830fedd5f4e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:37.580024 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-41886fed-8839-4e80-8165-3830fedd5f4e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:37.587067 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-41886fed-8839-4e80-8165-3830fedd5f4e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:37.587598 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-41886fed-8839-4e80-8165-3830fedd5f4e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:37.588047 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-41886fed-8839-4e80-8165-3830fedd5f4e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:37.588761 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-41886fed-8839-4e80-8165-3830fedd5f4e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:37.589220 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-41886fed-8839-4e80-8165-3830fedd5f4e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:37.589813 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-41886fed-8839-4e80-8165-3830fedd5f4e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:37.702423 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c6913fcd-9907-423d-963e-6be1b2b58fa7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:37.707684 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c6913fcd-9907-423d-963e-6be1b2b58fa7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:37.714995 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c6913fcd-9907-423d-963e-6be1b2b58fa7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:37.715792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c6913fcd-9907-423d-963e-6be1b2b58fa7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:37.716426 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c6913fcd-9907-423d-963e-6be1b2b58fa7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:37.717311 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c6913fcd-9907-423d-963e-6be1b2b58fa7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:37.718073 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c6913fcd-9907-423d-963e-6be1b2b58fa7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:37.718792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c6913fcd-9907-423d-963e-6be1b2b58fa7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:37.748477 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-41886fed-8839-4e80-8165-3830fedd5f4e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:37.769541 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-41886fed-8839-4e80-8165-3830fedd5f4e tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.195127 Aug 24 17:54:37.770126 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 387/746] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:37 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:37.870943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c6913fcd-9907-423d-963e-6be1b2b58fa7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:37.880522 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c6913fcd-9907-423d-963e-6be1b2b58fa7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:37.882028 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c6913fcd-9907-423d-963e-6be1b2b58fa7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:37.883333 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c6913fcd-9907-423d-963e-6be1b2b58fa7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.188811 Aug 24 17:54:37.883921 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 360/747] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:37 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:38.793739 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-74d2f68c-3273-44af-be19-5acf687d7f31 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:38.794513 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-74d2f68c-3273-44af-be19-5acf687d7f31 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:38.801715 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-74d2f68c-3273-44af-be19-5acf687d7f31 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:38.802214 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-74d2f68c-3273-44af-be19-5acf687d7f31 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:38.802653 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-74d2f68c-3273-44af-be19-5acf687d7f31 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:38.803366 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-74d2f68c-3273-44af-be19-5acf687d7f31 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:38.803851 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-74d2f68c-3273-44af-be19-5acf687d7f31 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:38.804280 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-74d2f68c-3273-44af-be19-5acf687d7f31 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:38.906243 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-58a4052a-11db-4aeb-89cc-7158c3ce852e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:38.906839 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-58a4052a-11db-4aeb-89cc-7158c3ce852e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:38.913610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58a4052a-11db-4aeb-89cc-7158c3ce852e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:38.914443 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58a4052a-11db-4aeb-89cc-7158c3ce852e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:38.915145 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58a4052a-11db-4aeb-89cc-7158c3ce852e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:38.916120 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58a4052a-11db-4aeb-89cc-7158c3ce852e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:38.916801 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58a4052a-11db-4aeb-89cc-7158c3ce852e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:38.917446 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-58a4052a-11db-4aeb-89cc-7158c3ce852e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:38.947958 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-74d2f68c-3273-44af-be19-5acf687d7f31 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:38.957316 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-74d2f68c-3273-44af-be19-5acf687d7f31 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.167845 Aug 24 17:54:38.958098 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 388/748] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:38 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:39.068465 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-58a4052a-11db-4aeb-89cc-7158c3ce852e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:39.078067 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-58a4052a-11db-4aeb-89cc-7158c3ce852e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:39.079846 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-58a4052a-11db-4aeb-89cc-7158c3ce852e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:39.081006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-58a4052a-11db-4aeb-89cc-7158c3ce852e tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.178713 Aug 24 17:54:39.081745 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 361/749] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:38 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:39.978104 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-039a50dd-b3d2-4e33-bf38-f4fa1a1c4b93 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:39.978822 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-039a50dd-b3d2-4e33-bf38-f4fa1a1c4b93 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:39.985852 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-039a50dd-b3d2-4e33-bf38-f4fa1a1c4b93 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:39.986404 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-039a50dd-b3d2-4e33-bf38-f4fa1a1c4b93 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:39.986779 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-039a50dd-b3d2-4e33-bf38-f4fa1a1c4b93 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:39.987495 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-039a50dd-b3d2-4e33-bf38-f4fa1a1c4b93 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:39.987961 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-039a50dd-b3d2-4e33-bf38-f4fa1a1c4b93 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:39.988386 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-039a50dd-b3d2-4e33-bf38-f4fa1a1c4b93 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:40.104804 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6aaecc13-ce5b-4179-97e2-3feae36e3a7b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:40.106285 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6aaecc13-ce5b-4179-97e2-3feae36e3a7b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:40.113202 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6aaecc13-ce5b-4179-97e2-3feae36e3a7b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:40.113688 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6aaecc13-ce5b-4179-97e2-3feae36e3a7b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:40.114120 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6aaecc13-ce5b-4179-97e2-3feae36e3a7b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:40.114818 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6aaecc13-ce5b-4179-97e2-3feae36e3a7b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:40.115279 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6aaecc13-ce5b-4179-97e2-3feae36e3a7b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:40.115720 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6aaecc13-ce5b-4179-97e2-3feae36e3a7b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:40.135103 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-039a50dd-b3d2-4e33-bf38-f4fa1a1c4b93 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:40.144637 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-039a50dd-b3d2-4e33-bf38-f4fa1a1c4b93 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.170390 Aug 24 17:54:40.145524 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 389/750] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:39 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:40.260706 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6aaecc13-ce5b-4179-97e2-3feae36e3a7b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:40.269779 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6aaecc13-ce5b-4179-97e2-3feae36e3a7b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:40.271296 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6aaecc13-ce5b-4179-97e2-3feae36e3a7b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:40.272495 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6aaecc13-ce5b-4179-97e2-3feae36e3a7b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.173608 Aug 24 17:54:40.273048 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 362/751] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:40 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:54:41.165691 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0850aa0f-84ce-42b0-94a8-7450245bcef9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:41.166311 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0850aa0f-84ce-42b0-94a8-7450245bcef9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:41.172797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0850aa0f-84ce-42b0-94a8-7450245bcef9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:41.173287 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0850aa0f-84ce-42b0-94a8-7450245bcef9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:41.173722 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0850aa0f-84ce-42b0-94a8-7450245bcef9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:41.174414 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0850aa0f-84ce-42b0-94a8-7450245bcef9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:41.174872 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0850aa0f-84ce-42b0-94a8-7450245bcef9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:41.175293 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0850aa0f-84ce-42b0-94a8-7450245bcef9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:41.295845 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3902707e-7267-45e8-a878-11d87f0918e7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:41.296421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3902707e-7267-45e8-a878-11d87f0918e7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:41.303372 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3902707e-7267-45e8-a878-11d87f0918e7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:41.303892 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3902707e-7267-45e8-a878-11d87f0918e7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:41.304247 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-0850aa0f-84ce-42b0-94a8-7450245bcef9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:41.304377 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3902707e-7267-45e8-a878-11d87f0918e7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:41.305005 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3902707e-7267-45e8-a878-11d87f0918e7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:41.305455 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3902707e-7267-45e8-a878-11d87f0918e7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:41.305873 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3902707e-7267-45e8-a878-11d87f0918e7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:41.311940 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0850aa0f-84ce-42b0-94a8-7450245bcef9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.150079 Aug 24 17:54:41.313050 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 390/752] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:41 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:41.438542 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-3902707e-7267-45e8-a878-11d87f0918e7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:41.446610 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-3902707e-7267-45e8-a878-11d87f0918e7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:41.448990 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-3902707e-7267-45e8-a878-11d87f0918e7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:41.450158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-3902707e-7267-45e8-a878-11d87f0918e7 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.158315 Aug 24 17:54:41.450716 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 363/753] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:41 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:54:42.333476 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b723fd23-7f0f-469f-81b0-3b792b23d15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:42.334094 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b723fd23-7f0f-469f-81b0-3b792b23d15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:42.340461 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b723fd23-7f0f-469f-81b0-3b792b23d15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:42.340949 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b723fd23-7f0f-469f-81b0-3b792b23d15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:42.341389 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b723fd23-7f0f-469f-81b0-3b792b23d15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:42.342090 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b723fd23-7f0f-469f-81b0-3b792b23d15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:42.342547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b723fd23-7f0f-469f-81b0-3b792b23d15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:42.342990 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b723fd23-7f0f-469f-81b0-3b792b23d15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:42.471148 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b723fd23-7f0f-469f-81b0-3b792b23d15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:42.473681 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-665f0b77-3fc2-479c-a667-68d6a63f55c3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:42.474290 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-665f0b77-3fc2-479c-a667-68d6a63f55c3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:42.478822 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b723fd23-7f0f-469f-81b0-3b792b23d15f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.149480 Aug 24 17:54:42.479392 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 391/754] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:42 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:42.480550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-665f0b77-3fc2-479c-a667-68d6a63f55c3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:42.481021 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-665f0b77-3fc2-479c-a667-68d6a63f55c3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:42.481448 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-665f0b77-3fc2-479c-a667-68d6a63f55c3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:42.482131 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-665f0b77-3fc2-479c-a667-68d6a63f55c3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:42.482577 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-665f0b77-3fc2-479c-a667-68d6a63f55c3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:42.482992 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-665f0b77-3fc2-479c-a667-68d6a63f55c3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:42.616775 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-665f0b77-3fc2-479c-a667-68d6a63f55c3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:42.624839 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-665f0b77-3fc2-479c-a667-68d6a63f55c3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:42.626342 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-665f0b77-3fc2-479c-a667-68d6a63f55c3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:42.627500 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-665f0b77-3fc2-479c-a667-68d6a63f55c3 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.157813 Aug 24 17:54:42.628127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 364/755] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:42 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:43.187952 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-977784fd-f017-4e47-a0fa-24d10be76ade tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:43.188452 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-977784fd-f017-4e47-a0fa-24d10be76ade tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:43.194369 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-977784fd-f017-4e47-a0fa-24d10be76ade tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:43.194855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-977784fd-f017-4e47-a0fa-24d10be76ade tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:43.195293 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-977784fd-f017-4e47-a0fa-24d10be76ade tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:43.196020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-977784fd-f017-4e47-a0fa-24d10be76ade tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:43.196483 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-977784fd-f017-4e47-a0fa-24d10be76ade tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:43.196913 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-977784fd-f017-4e47-a0fa-24d10be76ade tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:43.219755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-977784fd-f017-4e47-a0fa-24d10be76ade tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a/ips" status: 200 len: 150 microversion: 2.1 time: 0.035655 Aug 24 17:54:43.220307 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 392/756] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 17:54:43 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:43.501191 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e88e9223-7944-492a-ad24-c77809f44e18 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:43.502135 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e88e9223-7944-492a-ad24-c77809f44e18 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:43.523959 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e88e9223-7944-492a-ad24-c77809f44e18 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:43.524464 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e88e9223-7944-492a-ad24-c77809f44e18 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:43.524903 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e88e9223-7944-492a-ad24-c77809f44e18 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:43.525619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e88e9223-7944-492a-ad24-c77809f44e18 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:43.526079 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e88e9223-7944-492a-ad24-c77809f44e18 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:43.526505 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e88e9223-7944-492a-ad24-c77809f44e18 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:43.652815 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8b32dc3c-0c5d-4c22-8bc5-41e6cccc1058 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:43.653844 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8b32dc3c-0c5d-4c22-8bc5-41e6cccc1058 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:43.663041 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b32dc3c-0c5d-4c22-8bc5-41e6cccc1058 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:43.664169 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b32dc3c-0c5d-4c22-8bc5-41e6cccc1058 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:43.665070 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b32dc3c-0c5d-4c22-8bc5-41e6cccc1058 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:43.665874 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b32dc3c-0c5d-4c22-8bc5-41e6cccc1058 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:43.666557 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b32dc3c-0c5d-4c22-8bc5-41e6cccc1058 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:43.667241 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b32dc3c-0c5d-4c22-8bc5-41e6cccc1058 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:43.677897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e88e9223-7944-492a-ad24-c77809f44e18 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:43.686135 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e88e9223-7944-492a-ad24-c77809f44e18 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1267 microversion: 2.1 time: 0.191155 Aug 24 17:54:43.687001 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 365/757] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:43 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:43.813790 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8b32dc3c-0c5d-4c22-8bc5-41e6cccc1058 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:43.821851 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8b32dc3c-0c5d-4c22-8bc5-41e6cccc1058 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:43.823401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8b32dc3c-0c5d-4c22-8bc5-41e6cccc1058 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:43.824588 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8b32dc3c-0c5d-4c22-8bc5-41e6cccc1058 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.177679 Aug 24 17:54:43.825142 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 393/758] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:43 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:44.596287 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6cccf3a7-8960-4168-99b4-ed7a649d1108 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "080ffc66-28d1-443f-9699-50ad0569b3f1"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:44.598619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6cccf3a7-8960-4168-99b4-ed7a649d1108 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:44.604994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6cccf3a7-8960-4168-99b4-ed7a649d1108 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:44.605504 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6cccf3a7-8960-4168-99b4-ed7a649d1108 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:44.605940 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6cccf3a7-8960-4168-99b4-ed7a649d1108 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:44.606633 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6cccf3a7-8960-4168-99b4-ed7a649d1108 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:44.607095 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6cccf3a7-8960-4168-99b4-ed7a649d1108 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:44.607551 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6cccf3a7-8960-4168-99b4-ed7a649d1108 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:44.707536 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4be3f359-b594-4876-b064-8a71420ce4f3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:44.708152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4be3f359-b594-4876-b064-8a71420ce4f3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:44.715572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4be3f359-b594-4876-b064-8a71420ce4f3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:44.716066 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4be3f359-b594-4876-b064-8a71420ce4f3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:44.716502 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4be3f359-b594-4876-b064-8a71420ce4f3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:44.717201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4be3f359-b594-4876-b064-8a71420ce4f3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:44.717657 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4be3f359-b594-4876-b064-8a71420ce4f3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:44.718171 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4be3f359-b594-4876-b064-8a71420ce4f3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:44.853272 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6cccf3a7-8960-4168-99b4-ed7a649d1108 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261451 Aug 24 17:54:44.854049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 366/759] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:54:44 2022] POST /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:44.860470 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f2635f3d-79f7-4a8f-8d86-5ef78588a662 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:44.861380 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f2635f3d-79f7-4a8f-8d86-5ef78588a662 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:44.862991 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4be3f359-b594-4876-b064-8a71420ce4f3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:44.868410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2635f3d-79f7-4a8f-8d86-5ef78588a662 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:44.868939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2635f3d-79f7-4a8f-8d86-5ef78588a662 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:44.869377 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2635f3d-79f7-4a8f-8d86-5ef78588a662 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:44.870085 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2635f3d-79f7-4a8f-8d86-5ef78588a662 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:44.870594 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2635f3d-79f7-4a8f-8d86-5ef78588a662 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:44.871104 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f2635f3d-79f7-4a8f-8d86-5ef78588a662 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:44.873641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4be3f359-b594-4876-b064-8a71420ce4f3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1452 microversion: 2.1 time: 0.171345 Aug 24 17:54:44.875022 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 394/760] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:44 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:44.900029 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c7a416e7-517d-4832-8464-5cb688a72dff tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:44.900656 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c7a416e7-517d-4832-8464-5cb688a72dff tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:44.906772 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c7a416e7-517d-4832-8464-5cb688a72dff tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:44.907271 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c7a416e7-517d-4832-8464-5cb688a72dff tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:44.907936 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c7a416e7-517d-4832-8464-5cb688a72dff tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:44.908645 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c7a416e7-517d-4832-8464-5cb688a72dff tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:44.909107 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c7a416e7-517d-4832-8464-5cb688a72dff tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:44.909537 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c7a416e7-517d-4832-8464-5cb688a72dff tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:45.026175 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f2635f3d-79f7-4a8f-8d86-5ef78588a662 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:45.036937 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f2635f3d-79f7-4a8f-8d86-5ef78588a662 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:45.038532 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-f2635f3d-79f7-4a8f-8d86-5ef78588a662 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:45.040259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-f2635f3d-79f7-4a8f-8d86-5ef78588a662 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.185138 Aug 24 17:54:45.043847 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 367/761] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:44 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:45.063674 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c7a416e7-517d-4832-8464-5cb688a72dff tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:45.071280 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c7a416e7-517d-4832-8464-5cb688a72dff tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1452 microversion: 2.1 time: 0.179899 Aug 24 17:54:45.071896 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 395/762] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:44 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:54:45.690782 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-1aad9b7c-7e38-4f7c-8cc7-ed5a96919ea5 req-59bac5f2-a16b-442e-bd8e-c5359ca1587d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34147b78-b9f5-4566-8d38-f0ed7ef27e7f", "name": "network-vif-plugged", "status": "completed", "tag": "2ae11597-17eb-4280-8c34-d47ce491867b"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:45.697529 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:45.704336 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-1aad9b7c-7e38-4f7c-8cc7-ed5a96919ea5 req-59bac5f2-a16b-442e-bd8e-c5359ca1587d service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:45.704883 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-1aad9b7c-7e38-4f7c-8cc7-ed5a96919ea5 req-59bac5f2-a16b-442e-bd8e-c5359ca1587d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:45.705306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-1aad9b7c-7e38-4f7c-8cc7-ed5a96919ea5 req-59bac5f2-a16b-442e-bd8e-c5359ca1587d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:45.882213 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-1aad9b7c-7e38-4f7c-8cc7-ed5a96919ea5 req-59bac5f2-a16b-442e-bd8e-c5359ca1587d service nova] Creating event network-vif-plugged:2ae11597-17eb-4280-8c34-d47ce491867b for instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f on hv-cinder-84052 Aug 24 17:54:45.887037 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-1aad9b7c-7e38-4f7c-8cc7-ed5a96919ea5 req-59bac5f2-a16b-442e-bd8e-c5359ca1587d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200917 Aug 24 17:54:45.887653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 368/763] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:46.063558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4f4e04cc-d91f-4849-974e-7e1367bfc07d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:46.064356 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4f4e04cc-d91f-4849-974e-7e1367bfc07d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:46.067922 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:46.072573 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4f4e04cc-d91f-4849-974e-7e1367bfc07d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:46.073239 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4f4e04cc-d91f-4849-974e-7e1367bfc07d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:46.073822 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4f4e04cc-d91f-4849-974e-7e1367bfc07d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:46.074807 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4f4e04cc-d91f-4849-974e-7e1367bfc07d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:46.075141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4f4e04cc-d91f-4849-974e-7e1367bfc07d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:46.075813 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4f4e04cc-d91f-4849-974e-7e1367bfc07d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:46.300788 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4f4e04cc-d91f-4849-974e-7e1367bfc07d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:46.309167 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4f4e04cc-d91f-4849-974e-7e1367bfc07d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:46.310673 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4f4e04cc-d91f-4849-974e-7e1367bfc07d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:46.312369 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4f4e04cc-d91f-4849-974e-7e1367bfc07d tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.253436 Aug 24 17:54:46.312931 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 396/764] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:46 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:46.759959 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-9dfa0567-3200-4d26-9f49-a12f1abd4c86 req-0db5c404-35c6-4be0-989a-e5a108708f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38237468-6ade-46a7-830f-371a8a34c4f4", "tag": "68a6e936-3e2e-4bc2-ab59-de0b96e000d7"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:46.770693 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-9dfa0567-3200-4d26-9f49-a12f1abd4c86 req-0db5c404-35c6-4be0-989a-e5a108708f3c service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:46.771303 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-9dfa0567-3200-4d26-9f49-a12f1abd4c86 req-0db5c404-35c6-4be0-989a-e5a108708f3c service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:46.771962 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-9dfa0567-3200-4d26-9f49-a12f1abd4c86 req-0db5c404-35c6-4be0-989a-e5a108708f3c service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:46.784481 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-9dfa0567-3200-4d26-9f49-a12f1abd4c86 req-0db5c404-35c6-4be0-989a-e5a108708f3c service nova] Creating event network-changed:68a6e936-3e2e-4bc2-ab59-de0b96e000d7 for instance 38237468-6ade-46a7-830f-371a8a34c4f4 on hv-cinder-84052 Aug 24 17:54:46.789598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-9dfa0567-3200-4d26-9f49-a12f1abd4c86 req-0db5c404-35c6-4be0-989a-e5a108708f3c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034409 Aug 24 17:54:46.790299 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 369/765] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:47.334810 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-279fc5f3-d2da-4077-baf5-c3d79b2607f1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:47.336068 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-279fc5f3-d2da-4077-baf5-c3d79b2607f1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:47.343856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-279fc5f3-d2da-4077-baf5-c3d79b2607f1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:47.344563 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-279fc5f3-d2da-4077-baf5-c3d79b2607f1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:47.345498 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-279fc5f3-d2da-4077-baf5-c3d79b2607f1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:47.346428 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-279fc5f3-d2da-4077-baf5-c3d79b2607f1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:47.348772 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-279fc5f3-d2da-4077-baf5-c3d79b2607f1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:47.349675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-279fc5f3-d2da-4077-baf5-c3d79b2607f1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:47.531800 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-279fc5f3-d2da-4077-baf5-c3d79b2607f1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:47.540694 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-279fc5f3-d2da-4077-baf5-c3d79b2607f1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:47.542370 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-279fc5f3-d2da-4077-baf5-c3d79b2607f1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:47.543371 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-279fc5f3-d2da-4077-baf5-c3d79b2607f1 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1728 microversion: 2.20 time: 0.212404 Aug 24 17:54:47.545236 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 397/766] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:47 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:48.569086 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7be797bd-510e-47fa-83e0-af3f284f3678 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:48.569805 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7be797bd-510e-47fa-83e0-af3f284f3678 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:48.575919 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7be797bd-510e-47fa-83e0-af3f284f3678 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.576399 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7be797bd-510e-47fa-83e0-af3f284f3678 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.576831 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7be797bd-510e-47fa-83e0-af3f284f3678 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.578146 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7be797bd-510e-47fa-83e0-af3f284f3678 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:48.578599 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7be797bd-510e-47fa-83e0-af3f284f3678 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:48.579291 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7be797bd-510e-47fa-83e0-af3f284f3678 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:48.706313 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7be797bd-510e-47fa-83e0-af3f284f3678 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:48.709844 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:48.715246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7be797bd-510e-47fa-83e0-af3f284f3678 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:48.716799 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7be797bd-510e-47fa-83e0-af3f284f3678 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:48.717942 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7be797bd-510e-47fa-83e0-af3f284f3678 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1715 microversion: 2.20 time: 0.153614 Aug 24 17:54:48.718492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 370/767] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:54:48 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:54:52.405963 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c3df9bc7-1326-4fde-8806-e831bf1ba535 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: .version_select at 0x7f4b297951f0>, body: {"keypair": {"name": "tempest-keypair-689567904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpgauwpZ2b42UdcmkZCII5sz72JzOkp/2Y6o5fjMSI3hSTMep5EywyTBun6xlt0pQ3qlPdL/FUSC8H01qbT8dt4lyceQ/F4TclxmefQoLrj6LePQ0UFeiGVnBdnFAwHAA=="}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:52.421634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-c3df9bc7-1326-4fde-8806-e831bf1ba535 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for project 625652cfa47248faac8c1f7759c56a14. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:54:52.425443 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-c3df9bc7-1326-4fde-8806-e831bf1ba535 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for user d8b9d2b042c04927b9115085fcb4ba40 and project 625652cfa47248faac8c1f7759c56a14. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:54:52.446859 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c3df9bc7-1326-4fde-8806-e831bf1ba535 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045028 Aug 24 17:54:52.447440 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 398/768] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 17:54:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:54:53.651692 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1788949684", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87807a97-d368-4c81-a10c-4e62e5ebdb01"}], "security_groups": [{"name": "tempest-securitygroup--553239301"}], "key_name": "tempest-keypair-689567904", "user_data": "}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:53.763325 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] validate_networks() for [('87807a97-d368-4c81-a10c-4e62e5ebdb01', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:54:54.131230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:54:54.131709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:54:54.132185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:54:54.132593 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:54:54.133003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:54:54.142149 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:54.142629 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:54.143063 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:54.143831 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:54.144287 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:54.144712 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:54.161775 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for project 625652cfa47248faac8c1f7759c56a14. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:54:54.165713 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for user d8b9d2b042c04927b9115085fcb4ba40 and project 625652cfa47248faac8c1f7759c56a14. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:54:54.176620 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:54:54.178868 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:54:54.227013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-37c6a17d-1620-4072-b1bf-2981f60598e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.580589 Aug 24 17:54:54.227688 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 371/769] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:54:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:54:54.239141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c4c249e4-07dd-4c99-9f5c-345a115cabac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:54.239869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c4c249e4-07dd-4c99-9f5c-345a115cabac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:54.293985 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c4c249e4-07dd-4c99-9f5c-345a115cabac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:54.302092 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c4c249e4-07dd-4c99-9f5c-345a115cabac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1241 microversion: 2.1 time: 0.067267 Aug 24 17:54:54.302651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 399/770] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:54 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:55.324091 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a7f5c22e-e7e2-4786-9cca-90a6331c89dc tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:55.324738 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a7f5c22e-e7e2-4786-9cca-90a6331c89dc tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:55.331701 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a7f5c22e-e7e2-4786-9cca-90a6331c89dc tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:55.332185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a7f5c22e-e7e2-4786-9cca-90a6331c89dc tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:55.332614 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a7f5c22e-e7e2-4786-9cca-90a6331c89dc tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:55.333295 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a7f5c22e-e7e2-4786-9cca-90a6331c89dc tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:55.333750 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a7f5c22e-e7e2-4786-9cca-90a6331c89dc tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:55.334303 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a7f5c22e-e7e2-4786-9cca-90a6331c89dc tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:55.407648 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a7f5c22e-e7e2-4786-9cca-90a6331c89dc tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:55.415093 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a7f5c22e-e7e2-4786-9cca-90a6331c89dc tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1311 microversion: 2.1 time: 0.095541 Aug 24 17:54:55.415963 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 372/771] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:55 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:56.437543 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-de0d74d0-e39f-41e6-8f85-187c5cedc44d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:56.438197 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-de0d74d0-e39f-41e6-8f85-187c5cedc44d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:56.444877 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-de0d74d0-e39f-41e6-8f85-187c5cedc44d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:56.445372 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-de0d74d0-e39f-41e6-8f85-187c5cedc44d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:56.445814 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-de0d74d0-e39f-41e6-8f85-187c5cedc44d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:56.446512 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-de0d74d0-e39f-41e6-8f85-187c5cedc44d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:56.446971 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-de0d74d0-e39f-41e6-8f85-187c5cedc44d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:56.447399 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-de0d74d0-e39f-41e6-8f85-187c5cedc44d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:56.585378 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-de0d74d0-e39f-41e6-8f85-187c5cedc44d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:56.594076 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-de0d74d0-e39f-41e6-8f85-187c5cedc44d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1366 microversion: 2.1 time: 0.161144 Aug 24 17:54:56.594643 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 400/772] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:56 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:56.777202 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-7a3ff4ea-8b5d-4286-8bd4-d3b1aedd8893 req-e53ba915-b020-40fa-b2c1-293f41f1651b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9880c9-7222-4fa9-a5f0-2dbca7500cf2", "tag": "6c39b813-4893-4572-b87a-9cfa16992682"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:54:56.788892 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-7a3ff4ea-8b5d-4286-8bd4-d3b1aedd8893 req-e53ba915-b020-40fa-b2c1-293f41f1651b service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:56.789641 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-7a3ff4ea-8b5d-4286-8bd4-d3b1aedd8893 req-e53ba915-b020-40fa-b2c1-293f41f1651b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:56.790070 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-7a3ff4ea-8b5d-4286-8bd4-d3b1aedd8893 req-e53ba915-b020-40fa-b2c1-293f41f1651b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:56.802777 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-7a3ff4ea-8b5d-4286-8bd4-d3b1aedd8893 req-e53ba915-b020-40fa-b2c1-293f41f1651b service nova] Creating event network-changed:6c39b813-4893-4572-b87a-9cfa16992682 for instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 on hv-cinder-84052 Aug 24 17:54:56.807568 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-7a3ff4ea-8b5d-4286-8bd4-d3b1aedd8893 req-e53ba915-b020-40fa-b2c1-293f41f1651b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034504 Aug 24 17:54:56.808158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 373/773] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:54:57.615021 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-90bd32c2-ea02-4221-abf3-ccdc09e3e96d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:57.615656 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-90bd32c2-ea02-4221-abf3-ccdc09e3e96d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:57.622033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-90bd32c2-ea02-4221-abf3-ccdc09e3e96d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:57.622509 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-90bd32c2-ea02-4221-abf3-ccdc09e3e96d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:57.622943 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-90bd32c2-ea02-4221-abf3-ccdc09e3e96d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:57.624167 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-90bd32c2-ea02-4221-abf3-ccdc09e3e96d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:57.624616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-90bd32c2-ea02-4221-abf3-ccdc09e3e96d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:57.625033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-90bd32c2-ea02-4221-abf3-ccdc09e3e96d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:57.756160 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-90bd32c2-ea02-4221-abf3-ccdc09e3e96d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:57.758359 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=100 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:54:57.764891 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-90bd32c2-ea02-4221-abf3-ccdc09e3e96d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1366 microversion: 2.1 time: 0.153747 Aug 24 17:54:57.765449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 401/774] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:57 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:58.787395 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-540ee274-819c-46b3-b2ab-758d32c6ed52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:58.788127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-540ee274-819c-46b3-b2ab-758d32c6ed52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:58.794170 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-540ee274-819c-46b3-b2ab-758d32c6ed52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:58.794651 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-540ee274-819c-46b3-b2ab-758d32c6ed52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:58.795101 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-540ee274-819c-46b3-b2ab-758d32c6ed52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:58.795828 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-540ee274-819c-46b3-b2ab-758d32c6ed52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:58.796286 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-540ee274-819c-46b3-b2ab-758d32c6ed52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:58.796712 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-540ee274-819c-46b3-b2ab-758d32c6ed52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:58.923565 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-540ee274-819c-46b3-b2ab-758d32c6ed52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:54:58.931193 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-540ee274-819c-46b3-b2ab-758d32c6ed52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1366 microversion: 2.1 time: 0.148625 Aug 24 17:54:58.931788 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 374/775] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:58 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:54:59.953201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4440757c-d102-440e-bf0e-1046a67d61a7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:54:59.954195 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4440757c-d102-440e-bf0e-1046a67d61a7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:54:59.961448 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4440757c-d102-440e-bf0e-1046a67d61a7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:59.961999 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4440757c-d102-440e-bf0e-1046a67d61a7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:59.962500 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4440757c-d102-440e-bf0e-1046a67d61a7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:54:59.963391 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4440757c-d102-440e-bf0e-1046a67d61a7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:54:59.963903 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4440757c-d102-440e-bf0e-1046a67d61a7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:54:59.964326 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4440757c-d102-440e-bf0e-1046a67d61a7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:00.093268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4440757c-d102-440e-bf0e-1046a67d61a7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:00.101224 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4440757c-d102-440e-bf0e-1046a67d61a7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1366 microversion: 2.1 time: 0.152532 Aug 24 17:55:00.101882 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 402/776] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:54:59 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:01.122082 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-dc1305af-2058-4330-877f-fa9b54f7ad75 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:01.122722 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-dc1305af-2058-4330-877f-fa9b54f7ad75 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:01.129228 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc1305af-2058-4330-877f-fa9b54f7ad75 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:01.129714 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc1305af-2058-4330-877f-fa9b54f7ad75 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:01.130157 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc1305af-2058-4330-877f-fa9b54f7ad75 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:01.130848 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc1305af-2058-4330-877f-fa9b54f7ad75 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:01.131304 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc1305af-2058-4330-877f-fa9b54f7ad75 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:01.131762 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dc1305af-2058-4330-877f-fa9b54f7ad75 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:01.260678 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-dc1305af-2058-4330-877f-fa9b54f7ad75 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:01.268196 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-dc1305af-2058-4330-877f-fa9b54f7ad75 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1366 microversion: 2.1 time: 0.150057 Aug 24 17:55:01.268752 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 375/777] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:01 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:01.751232 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-185bf0fb-43c5-4902-a2a1-b8786396d8b6 req-234eebde-3ba3-449b-a303-32d9bfa91a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9880c9-7222-4fa9-a5f0-2dbca7500cf2", "name": "network-vif-plugged", "status": "completed", "tag": "6c39b813-4893-4572-b87a-9cfa16992682"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:01.762262 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-185bf0fb-43c5-4902-a2a1-b8786396d8b6 req-234eebde-3ba3-449b-a303-32d9bfa91a0c service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:01.762925 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-185bf0fb-43c5-4902-a2a1-b8786396d8b6 req-234eebde-3ba3-449b-a303-32d9bfa91a0c service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:01.763435 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-185bf0fb-43c5-4902-a2a1-b8786396d8b6 req-234eebde-3ba3-449b-a303-32d9bfa91a0c service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:01.775350 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-185bf0fb-43c5-4902-a2a1-b8786396d8b6 req-234eebde-3ba3-449b-a303-32d9bfa91a0c service nova] Creating event network-vif-plugged:6c39b813-4893-4572-b87a-9cfa16992682 for instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 on hv-cinder-84052 Aug 24 17:55:01.780281 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-185bf0fb-43c5-4902-a2a1-b8786396d8b6 req-234eebde-3ba3-449b-a303-32d9bfa91a0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032876 Aug 24 17:55:01.780865 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 403/778] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:02.289509 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0e84a9f5-431a-43d0-a9ea-7588087d6eba tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:02.290124 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0e84a9f5-431a-43d0-a9ea-7588087d6eba tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:02.297134 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e84a9f5-431a-43d0-a9ea-7588087d6eba tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:02.297621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e84a9f5-431a-43d0-a9ea-7588087d6eba tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:02.298056 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e84a9f5-431a-43d0-a9ea-7588087d6eba tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:02.298752 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e84a9f5-431a-43d0-a9ea-7588087d6eba tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:02.299210 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e84a9f5-431a-43d0-a9ea-7588087d6eba tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:02.299673 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e84a9f5-431a-43d0-a9ea-7588087d6eba tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:02.429003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0e84a9f5-431a-43d0-a9ea-7588087d6eba tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:02.436629 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0e84a9f5-431a-43d0-a9ea-7588087d6eba tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1366 microversion: 2.1 time: 0.151107 Aug 24 17:55:02.437788 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 376/779] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:02 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:03.458724 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ac395b3b-a83c-4016-94d5-bef9f89dcbc8 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:03.459441 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ac395b3b-a83c-4016-94d5-bef9f89dcbc8 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:03.466123 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ac395b3b-a83c-4016-94d5-bef9f89dcbc8 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:03.466599 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ac395b3b-a83c-4016-94d5-bef9f89dcbc8 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:03.467031 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ac395b3b-a83c-4016-94d5-bef9f89dcbc8 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:03.467757 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ac395b3b-a83c-4016-94d5-bef9f89dcbc8 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:03.468206 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ac395b3b-a83c-4016-94d5-bef9f89dcbc8 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:03.468628 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ac395b3b-a83c-4016-94d5-bef9f89dcbc8 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:03.601248 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ac395b3b-a83c-4016-94d5-bef9f89dcbc8 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:03.609016 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ac395b3b-a83c-4016-94d5-bef9f89dcbc8 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1366 microversion: 2.1 time: 0.154469 Aug 24 17:55:03.609663 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 404/780] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:03 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:04.630694 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-33881eb2-8975-43a9-883b-9bfd596ff945 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:04.631274 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-33881eb2-8975-43a9-883b-9bfd596ff945 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:04.633716 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:04.634510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=6 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:04.640714 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-33881eb2-8975-43a9-883b-9bfd596ff945 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:04.641203 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-33881eb2-8975-43a9-883b-9bfd596ff945 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:04.641714 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-33881eb2-8975-43a9-883b-9bfd596ff945 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:04.642395 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-33881eb2-8975-43a9-883b-9bfd596ff945 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:04.642843 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-33881eb2-8975-43a9-883b-9bfd596ff945 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:04.643268 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-33881eb2-8975-43a9-883b-9bfd596ff945 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:04.773109 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-33881eb2-8975-43a9-883b-9bfd596ff945 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:04.781510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-33881eb2-8975-43a9-883b-9bfd596ff945 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1556 microversion: 2.1 time: 0.154162 Aug 24 17:55:04.782075 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 377/781] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:04 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:04.801524 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-dbf2bd2a-52fb-494f-a6fe-4f8d75f476c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:04.802055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-dbf2bd2a-52fb-494f-a6fe-4f8d75f476c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:04.804012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=6 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:04.809661 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbf2bd2a-52fb-494f-a6fe-4f8d75f476c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:04.810141 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbf2bd2a-52fb-494f-a6fe-4f8d75f476c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:04.810577 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbf2bd2a-52fb-494f-a6fe-4f8d75f476c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:04.811269 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbf2bd2a-52fb-494f-a6fe-4f8d75f476c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:04.811752 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbf2bd2a-52fb-494f-a6fe-4f8d75f476c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:04.812688 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-dbf2bd2a-52fb-494f-a6fe-4f8d75f476c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:05.113788 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-dbf2bd2a-52fb-494f-a6fe-4f8d75f476c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.316228 Aug 24 17:55:05.114381 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 405/782] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 17:55:04 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2/os-interface => generated 284 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:06.017423 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-60638f51-85fe-49ca-b91b-0613c35642f4 req-379c239f-a714-49a2-8fca-6e790cea7c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9880c9-7222-4fa9-a5f0-2dbca7500cf2", "tag": "6c39b813-4893-4572-b87a-9cfa16992682"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:06.029037 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-60638f51-85fe-49ca-b91b-0613c35642f4 req-379c239f-a714-49a2-8fca-6e790cea7c7d service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:06.029037 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-60638f51-85fe-49ca-b91b-0613c35642f4 req-379c239f-a714-49a2-8fca-6e790cea7c7d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:06.029037 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-60638f51-85fe-49ca-b91b-0613c35642f4 req-379c239f-a714-49a2-8fca-6e790cea7c7d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:06.040119 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-60638f51-85fe-49ca-b91b-0613c35642f4 req-379c239f-a714-49a2-8fca-6e790cea7c7d service nova] Creating event network-changed:6c39b813-4893-4572-b87a-9cfa16992682 for instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 on hv-cinder-84052 Aug 24 17:55:06.045003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-60638f51-85fe-49ca-b91b-0613c35642f4 req-379c239f-a714-49a2-8fca-6e790cea7c7d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031992 Aug 24 17:55:06.045584 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 378/783] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:21.929620 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:21.930345 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=19 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:21.934427 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e190c485-5f3f-42a3-9162-65a7431caaac tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1106750636"}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:21.934966 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e190c485-5f3f-42a3-9162-65a7431caaac tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:21.941912 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e190c485-5f3f-42a3-9162-65a7431caaac tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:21.942396 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e190c485-5f3f-42a3-9162-65a7431caaac tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:21.942833 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e190c485-5f3f-42a3-9162-65a7431caaac tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:21.943550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e190c485-5f3f-42a3-9162-65a7431caaac tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:21.944007 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e190c485-5f3f-42a3-9162-65a7431caaac tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:21.944436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e190c485-5f3f-42a3-9162-65a7431caaac tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:22.075013 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.network.security_group_api [None req-e190c485-5f3f-42a3-9162-65a7431caaac tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Removing security group e579ecf1-2400-4e55-ad10-674179e9d30e from port dcaa2642-5d4e-4109-91ed-2b174f78eea6 Aug 24 17:55:22.380087 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e190c485-5f3f-42a3-9162-65a7431caaac tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "POST /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/action" status: 202 len: 0 microversion: 2.1 time: 0.451928 Aug 24 17:55:22.384069 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 406/784] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:55:21 2022] POST /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:55:22.399864 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-a060870b-ebfc-47c9-91de-e46e9162a976 req-a4d204df-fe8a-4a08-992b-bf4d8ef458d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3051bbe9-8766-4204-9998-a496565cfc22", "tag": "dcaa2642-5d4e-4109-91ed-2b174f78eea6"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:22.414386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:22.415241 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=36 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:22.421954 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-a060870b-ebfc-47c9-91de-e46e9162a976 req-a4d204df-fe8a-4a08-992b-bf4d8ef458d4 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:22.426102 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-a060870b-ebfc-47c9-91de-e46e9162a976 req-a4d204df-fe8a-4a08-992b-bf4d8ef458d4 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:22.428237 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-a060870b-ebfc-47c9-91de-e46e9162a976 req-a4d204df-fe8a-4a08-992b-bf4d8ef458d4 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:22.447884 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-a060870b-ebfc-47c9-91de-e46e9162a976 req-a4d204df-fe8a-4a08-992b-bf4d8ef458d4 service nova] Creating event network-changed:dcaa2642-5d4e-4109-91ed-2b174f78eea6 for instance 3051bbe9-8766-4204-9998-a496565cfc22 on hv-cinder-84052 Aug 24 17:55:22.453396 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-a060870b-ebfc-47c9-91de-e46e9162a976 req-a4d204df-fe8a-4a08-992b-bf4d8ef458d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064304 Aug 24 17:55:22.454238 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 379/785] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:23.604867 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fbaf931a-d280-4af4-a8e0-043b2f847e63 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:23.605399 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-fbaf931a-d280-4af4-a8e0-043b2f847e63 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:23.612214 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fbaf931a-d280-4af4-a8e0-043b2f847e63 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:23.612691 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fbaf931a-d280-4af4-a8e0-043b2f847e63 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:23.613120 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fbaf931a-d280-4af4-a8e0-043b2f847e63 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:23.613809 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fbaf931a-d280-4af4-a8e0-043b2f847e63 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:23.614256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fbaf931a-d280-4af4-a8e0-043b2f847e63 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:23.614670 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fbaf931a-d280-4af4-a8e0-043b2f847e63 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:23.695353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.objects.instance [None req-fbaf931a-d280-4af4-a8e0-043b2f847e63 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lazy-loading 'services' on Instance uuid 3051bbe9-8766-4204-9998-a496565cfc22 {{(pid=126994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:55:23.766390 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-fbaf931a-d280-4af4-a8e0-043b2f847e63 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/os-volume_attachments/369824ae-072e-43a2-b1e0-19f0528a71fe" status: 202 len: 0 microversion: 2.1 time: 0.165757 Aug 24 17:55:23.766986 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 407/786] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 17:55:23 2022] DELETE /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/os-volume_attachments/369824ae-072e-43a2-b1e0-19f0528a71fe => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:55:23.777254 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-471d3c6f-ea27-4f95-8027-978083cada31 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:23.778876 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-471d3c6f-ea27-4f95-8027-978083cada31 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:23.786652 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-471d3c6f-ea27-4f95-8027-978083cada31 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:23.787140 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-471d3c6f-ea27-4f95-8027-978083cada31 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:23.787831 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-471d3c6f-ea27-4f95-8027-978083cada31 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:23.789053 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-471d3c6f-ea27-4f95-8027-978083cada31 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:23.789657 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-471d3c6f-ea27-4f95-8027-978083cada31 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:23.790089 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-471d3c6f-ea27-4f95-8027-978083cada31 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:23.820936 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-471d3c6f-ea27-4f95-8027-978083cada31 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049257 Aug 24 17:55:23.821492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 380/787] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:55:23 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:24.468427 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-1c17e08a-20ca-4820-939c-0dd55c8c395e req-a9fd6983-ed6b-4057-b02f-d29a0281ae50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3051bbe9-8766-4204-9998-a496565cfc22", "tag": "dcaa2642-5d4e-4109-91ed-2b174f78eea6"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:24.478094 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-1c17e08a-20ca-4820-939c-0dd55c8c395e req-a9fd6983-ed6b-4057-b02f-d29a0281ae50 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.478574 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-1c17e08a-20ca-4820-939c-0dd55c8c395e req-a9fd6983-ed6b-4057-b02f-d29a0281ae50 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.479003 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-1c17e08a-20ca-4820-939c-0dd55c8c395e req-a9fd6983-ed6b-4057-b02f-d29a0281ae50 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.489634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-1c17e08a-20ca-4820-939c-0dd55c8c395e req-a9fd6983-ed6b-4057-b02f-d29a0281ae50 service nova] Creating event network-changed:dcaa2642-5d4e-4109-91ed-2b174f78eea6 for instance 3051bbe9-8766-4204-9998-a496565cfc22 on hv-cinder-84052 Aug 24 17:55:24.494517 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-1c17e08a-20ca-4820-939c-0dd55c8c395e req-a9fd6983-ed6b-4057-b02f-d29a0281ae50 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030332 Aug 24 17:55:24.495061 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 408/788] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:24.833978 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0be6fb02-0cd1-4f34-9ab3-7bfd6708e62c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:24.836231 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0be6fb02-0cd1-4f34-9ab3-7bfd6708e62c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:24.842549 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0be6fb02-0cd1-4f34-9ab3-7bfd6708e62c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.843035 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0be6fb02-0cd1-4f34-9ab3-7bfd6708e62c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.843471 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0be6fb02-0cd1-4f34-9ab3-7bfd6708e62c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.844186 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0be6fb02-0cd1-4f34-9ab3-7bfd6708e62c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.844642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0be6fb02-0cd1-4f34-9ab3-7bfd6708e62c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.845066 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0be6fb02-0cd1-4f34-9ab3-7bfd6708e62c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.873381 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0be6fb02-0cd1-4f34-9ab3-7bfd6708e62c tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043497 Aug 24 17:55:24.873971 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 381/789] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:55:24 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:55:24.885906 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7abe51dc-014a-4237-b38b-5a6c56804bf7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:24.886559 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7abe51dc-014a-4237-b38b-5a6c56804bf7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:24.893165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7abe51dc-014a-4237-b38b-5a6c56804bf7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.893651 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7abe51dc-014a-4237-b38b-5a6c56804bf7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.894127 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7abe51dc-014a-4237-b38b-5a6c56804bf7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.894829 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7abe51dc-014a-4237-b38b-5a6c56804bf7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:24.895285 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7abe51dc-014a-4237-b38b-5a6c56804bf7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:24.895830 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7abe51dc-014a-4237-b38b-5a6c56804bf7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:24.970906 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-7abe51dc-014a-4237-b38b-5a6c56804bf7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] HTTP exception thrown: Instance 3051bbe9-8766-4204-9998-a496565cfc22 is not attached to volume 369824ae-072e-43a2-b1e0-19f0528a71fe Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7abe51dc-014a-4237-b38b-5a6c56804bf7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Request method failure captured: Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: DELETE /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/os-volume_attachments/369824ae-072e-43a2-b1e0-19f0528a71fe HTTP/1.1 Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmVv35MR2nKP1AxP1S86dz9pmNW-fTPk8dENl9wTH9axtW6ntM5b1J6_zsKEUV3jAKZwbWNz22UDs0q4L_MNaghVYy9yD__1wD8mdzweAynzM2XY4acM-H6KdXRwesK7dAWznyWj4dgUmMN3URO0iah0sdM5kuVdX2DJQ40-BwXFRj4 Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: e78c5560d7874c7d9ae11d1a078090d9 Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-TestMinimumBasicScenario-197704933 Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:55:24.981250 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:55:24.982679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e78c5560d7874c7d9ae11d1a078090d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e78c5560d7874c7d9ae11d1a078090d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e78c5560d7874c7d9ae11d1a078090d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e78c5560d7874c7d9ae11d1a078090d9"}]}] Aug 24 17:55:24.982679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-TestMinimumBasicScenario-197704933 Aug 24 17:55:24.982679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: e78c5560d7874c7d9ae11d1a078090d9 Aug 24 17:55:24.982679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-TestMinimumBasicScenario-197704933 Aug 24 17:55:24.982679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-TestMinimumBasicScenario-197704933-project Aug 24 17:55:24.982679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:55:24.982679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:55:24.982679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: f07443b7cf95488a9ccb84895a63b92e Aug 24 17:55:24.982679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-TestMinimumBasicScenario-197704933-project Aug 24 17:55:24.982679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:55:24.982679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 3051bbe9-8766-4204-9998-a496565cfc22 is not attached to volume 369824ae-072e-43a2-b1e0-19f0528a71fe Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'server_id': '3051bbe9-8766-4204-9998-a496565cfc22', 'id': '369824ae-072e-43a2-b1e0-19f0528a71fe'} Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 369824ae-072e-43a2-b1e0-19f0528a71fe. Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:24.983449 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3051bbe9-8766-4204-9998-a496565cfc22 is not attached to volume 369824ae-072e-43a2-b1e0-19f0528a71fe Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3051bbe9-8766-4204-9998-a496565cfc22 is not attached to volume 369824ae-072e-43a2-b1e0-19f0528a71fe Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:24.985331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7abe51dc-014a-4237-b38b-5a6c56804bf7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Returning 404 to user: Instance 3051bbe9-8766-4204-9998-a496565cfc22 is not attached to volume 369824ae-072e-43a2-b1e0-19f0528a71fe {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:24.986288 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7abe51dc-014a-4237-b38b-5a6c56804bf7 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/os-volume_attachments/369824ae-072e-43a2-b1e0-19f0528a71fe" status: 404 len: 154 microversion: 2.1 time: 0.101550 Aug 24 17:55:24.986288 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 409/790] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 17:55:24 2022] DELETE /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22/os-volume_attachments/369824ae-072e-43a2-b1e0-19f0528a71fe => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:55:26.127524 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2d380107-4151-47b3-ad94-082024f09720 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:26.128015 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2d380107-4151-47b3-ad94-082024f09720 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:26.134504 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2d380107-4151-47b3-ad94-082024f09720 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:26.134990 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2d380107-4151-47b3-ad94-082024f09720 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:26.135425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2d380107-4151-47b3-ad94-082024f09720 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:26.136152 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2d380107-4151-47b3-ad94-082024f09720 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:26.136612 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2d380107-4151-47b3-ad94-082024f09720 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:26.137038 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2d380107-4151-47b3-ad94-082024f09720 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:26.162233 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2d380107-4151-47b3-ad94-082024f09720 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:55:26.233377 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2d380107-4151-47b3-ad94-082024f09720 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 204 len: 0 microversion: 2.1 time: 0.110121 Aug 24 17:55:26.233983 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 382/791] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:55:26 2022] DELETE /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:55:26.242117 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-af9bc6fe-335a-4218-b6e0-d8d496040f79 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:26.242736 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-af9bc6fe-335a-4218-b6e0-d8d496040f79 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:26.249088 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-af9bc6fe-335a-4218-b6e0-d8d496040f79 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:26.249570 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-af9bc6fe-335a-4218-b6e0-d8d496040f79 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:26.250003 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-af9bc6fe-335a-4218-b6e0-d8d496040f79 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:26.250686 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-af9bc6fe-335a-4218-b6e0-d8d496040f79 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:26.251142 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-af9bc6fe-335a-4218-b6e0-d8d496040f79 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:26.251589 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-af9bc6fe-335a-4218-b6e0-d8d496040f79 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:26.380212 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-af9bc6fe-335a-4218-b6e0-d8d496040f79 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:26.388088 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-af9bc6fe-335a-4218-b6e0-d8d496040f79 tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1553 microversion: 2.1 time: 0.149786 Aug 24 17:55:26.388692 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 410/792] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:26 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:27.409846 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2e379ec4-41b7-4f02-9c16-8b627201c88e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:27.410556 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2e379ec4-41b7-4f02-9c16-8b627201c88e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:27.416696 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2e379ec4-41b7-4f02-9c16-8b627201c88e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:27.417183 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2e379ec4-41b7-4f02-9c16-8b627201c88e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:27.417621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2e379ec4-41b7-4f02-9c16-8b627201c88e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:27.418315 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2e379ec4-41b7-4f02-9c16-8b627201c88e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:27.418771 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2e379ec4-41b7-4f02-9c16-8b627201c88e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:27.419195 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2e379ec4-41b7-4f02-9c16-8b627201c88e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:27.548934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2e379ec4-41b7-4f02-9c16-8b627201c88e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:27.556618 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2e379ec4-41b7-4f02-9c16-8b627201c88e tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1553 microversion: 2.1 time: 0.151587 Aug 24 17:55:27.557178 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 383/793] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:27 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:28.577715 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fa11665d-dd9c-4d11-95b0-ac4281d31bdb tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:28.579225 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-fa11665d-dd9c-4d11-95b0-ac4281d31bdb tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:28.595257 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fa11665d-dd9c-4d11-95b0-ac4281d31bdb tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.595976 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fa11665d-dd9c-4d11-95b0-ac4281d31bdb tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.596617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fa11665d-dd9c-4d11-95b0-ac4281d31bdb tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.597682 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fa11665d-dd9c-4d11-95b0-ac4281d31bdb tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.598327 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fa11665d-dd9c-4d11-95b0-ac4281d31bdb tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.598930 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fa11665d-dd9c-4d11-95b0-ac4281d31bdb tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.648693 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-d4629e8c-aa4e-409a-a0f0-7c8a1b299efb req-ed9c149c-ff78-45d5-b080-f9b90283059f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3051bbe9-8766-4204-9998-a496565cfc22", "name": "network-vif-deleted", "tag": "dcaa2642-5d4e-4109-91ed-2b174f78eea6"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:28.663420 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-d4629e8c-aa4e-409a-a0f0-7c8a1b299efb req-ed9c149c-ff78-45d5-b080-f9b90283059f service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.664223 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-d4629e8c-aa4e-409a-a0f0-7c8a1b299efb req-ed9c149c-ff78-45d5-b080-f9b90283059f service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.664660 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-d4629e8c-aa4e-409a-a0f0-7c8a1b299efb req-ed9c149c-ff78-45d5-b080-f9b90283059f service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.676490 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-fa11665d-dd9c-4d11-95b0-ac4281d31bdb tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07443b7cf95488a9ccb84895a63b92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78c5560d7874c7d9ae11d1a078090d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:28.678622 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-d4629e8c-aa4e-409a-a0f0-7c8a1b299efb req-ed9c149c-ff78-45d5-b080-f9b90283059f service nova] Creating event network-vif-deleted:dcaa2642-5d4e-4109-91ed-2b174f78eea6 for instance 3051bbe9-8766-4204-9998-a496565cfc22 on hv-cinder-84052 Aug 24 17:55:28.683439 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-d4629e8c-aa4e-409a-a0f0-7c8a1b299efb req-ed9c149c-ff78-45d5-b080-f9b90283059f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040145 Aug 24 17:55:28.684070 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 384/794] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:28.684526 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-fa11665d-dd9c-4d11-95b0-ac4281d31bdb tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 200 len: 1511 microversion: 2.1 time: 0.111723 Aug 24 17:55:28.685077 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 411/795] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:28 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 1511 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:28.937608 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1ad8c69e-290b-4c3e-a108-ad3ec6f50c6b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:28.940447 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1ad8c69e-290b-4c3e-a108-ad3ec6f50c6b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:28.946749 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ad8c69e-290b-4c3e-a108-ad3ec6f50c6b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.947231 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ad8c69e-290b-4c3e-a108-ad3ec6f50c6b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.947684 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ad8c69e-290b-4c3e-a108-ad3ec6f50c6b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.948377 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ad8c69e-290b-4c3e-a108-ad3ec6f50c6b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:28.948826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ad8c69e-290b-4c3e-a108-ad3ec6f50c6b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:28.949242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1ad8c69e-290b-4c3e-a108-ad3ec6f50c6b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:28.979982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1ad8c69e-290b-4c3e-a108-ad3ec6f50c6b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046594 Aug 24 17:55:28.980559 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 385/796] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Aug 24 17:55:28 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:29.044765 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e58b95d0-4069-4c46-b9b4-1ea0f5753374 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:29.045266 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e58b95d0-4069-4c46-b9b4-1ea0f5753374 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:29.051408 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e58b95d0-4069-4c46-b9b4-1ea0f5753374 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.052140 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e58b95d0-4069-4c46-b9b4-1ea0f5753374 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.052344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e58b95d0-4069-4c46-b9b4-1ea0f5753374 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.053049 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e58b95d0-4069-4c46-b9b4-1ea0f5753374 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.053514 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e58b95d0-4069-4c46-b9b4-1ea0f5753374 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.053939 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e58b95d0-4069-4c46-b9b4-1ea0f5753374 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.084079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e58b95d0-4069-4c46-b9b4-1ea0f5753374 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Going to try to terminate instance {{(pid=126994) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:55:29.163586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e58b95d0-4069-4c46-b9b4-1ea0f5753374 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "DELETE /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 204 len: 0 microversion: 2.20 time: 0.122428 Aug 24 17:55:29.164352 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 412/797] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Aug 24 17:55:29 2022] DELETE /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:55:29.173312 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-73c7ed6f-1c0d-43b3-813b-2c1b0fd4e530 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:29.173919 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-73c7ed6f-1c0d-43b3-813b-2c1b0fd4e530 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:29.179808 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-73c7ed6f-1c0d-43b3-813b-2c1b0fd4e530 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.180290 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-73c7ed6f-1c0d-43b3-813b-2c1b0fd4e530 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.180717 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-73c7ed6f-1c0d-43b3-813b-2c1b0fd4e530 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.181598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-73c7ed6f-1c0d-43b3-813b-2c1b0fd4e530 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.182050 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-73c7ed6f-1c0d-43b3-813b-2c1b0fd4e530 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.182463 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-73c7ed6f-1c0d-43b3-813b-2c1b0fd4e530 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.311389 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-73c7ed6f-1c0d-43b3-813b-2c1b0fd4e530 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:29.320060 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-73c7ed6f-1c0d-43b3-813b-2c1b0fd4e530 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:29.321581 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-73c7ed6f-1c0d-43b3-813b-2c1b0fd4e530 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:29.322744 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-73c7ed6f-1c0d-43b3-813b-2c1b0fd4e530 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.154135 Aug 24 17:55:29.323290 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 386/798] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:29 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:29.706377 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c04d9ca9-3db6-4a02-9c88-136e0ccfae2f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:29.706990 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c04d9ca9-3db6-4a02-9c88-136e0ccfae2f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] [instance: 3051bbe9-8766-4204-9998-a496565cfc22] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:29.713362 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c04d9ca9-3db6-4a02-9c88-136e0ccfae2f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.713840 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c04d9ca9-3db6-4a02-9c88-136e0ccfae2f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.714268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c04d9ca9-3db6-4a02-9c88-136e0ccfae2f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.714944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c04d9ca9-3db6-4a02-9c88-136e0ccfae2f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:29.715391 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c04d9ca9-3db6-4a02-9c88-136e0ccfae2f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:29.715835 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c04d9ca9-3db6-4a02-9c88-136e0ccfae2f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:29.729527 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-c04d9ca9-3db6-4a02-9c88-136e0ccfae2f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] HTTP exception thrown: Instance 3051bbe9-8766-4204-9998-a496565cfc22 could not be found. Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c04d9ca9-3db6-4a02-9c88-136e0ccfae2f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Request method failure captured: Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 HTTP/1.1 Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmVv35MR2nKP1AxP1S86dz9pmNW-fTPk8dENl9wTH9axtW6ntM5b1J6_zsKEUV3jAKZwbWNz22UDs0q4L_MNaghVYy9yD__1wD8mdzweAynzM2XY4acM-H6KdXRwesK7dAWznyWj4dgUmMN3URO0iah0sdM5kuVdX2DJQ40-BwXFRj4 Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: e78c5560d7874c7d9ae11d1a078090d9 Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-TestMinimumBasicScenario-197704933 Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:55:29.731146 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:55:29.732797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e78c5560d7874c7d9ae11d1a078090d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e78c5560d7874c7d9ae11d1a078090d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e78c5560d7874c7d9ae11d1a078090d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e78c5560d7874c7d9ae11d1a078090d9"}]}] Aug 24 17:55:29.732797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-TestMinimumBasicScenario-197704933 Aug 24 17:55:29.732797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: e78c5560d7874c7d9ae11d1a078090d9 Aug 24 17:55:29.732797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-TestMinimumBasicScenario-197704933 Aug 24 17:55:29.732797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-TestMinimumBasicScenario-197704933-project Aug 24 17:55:29.732797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:55:29.732797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:55:29.732797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: f07443b7cf95488a9ccb84895a63b92e Aug 24 17:55:29.732797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-TestMinimumBasicScenario-197704933-project Aug 24 17:55:29.732797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:55:29.732797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 3051bbe9-8766-4204-9998-a496565cfc22 could not be found. Aug 24 17:55:29.732797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '3051bbe9-8766-4204-9998-a496565cfc22'} Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3051bbe9-8766-4204-9998-a496565cfc22 could not be found. Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:29.733723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3051bbe9-8766-4204-9998-a496565cfc22 could not be found. Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3051bbe9-8766-4204-9998-a496565cfc22 could not be found. Aug 24 17:55:29.735794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:29.737005 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c04d9ca9-3db6-4a02-9c88-136e0ccfae2f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Returning 404 to user: Instance 3051bbe9-8766-4204-9998-a496565cfc22 could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:29.737005 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c04d9ca9-3db6-4a02-9c88-136e0ccfae2f tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22" status: 404 len: 111 microversion: 2.1 time: 0.030708 Aug 24 17:55:29.737005 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 413/799] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:29 2022] GET /compute/v2.1/servers/3051bbe9-8766-4204-9998-a496565cfc22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:55:29.742178 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b769659d-cb37-43d1-99b9-d3c826ad6a9b tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] Calling method '.version_select at 0x7f4b296bf3a0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:29.760009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b769659d-cb37-43d1-99b9-d3c826ad6a9b tempest-TestMinimumBasicScenario-197704933 tempest-TestMinimumBasicScenario-197704933-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-965320784" status: 202 len: 0 microversion: 2.1 time: 0.021647 Aug 24 17:55:29.760569 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 387/800] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Aug 24 17:55:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-965320784 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:55:30.346091 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-db50948c-0fee-4898-8908-43ca23ba194c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:30.346697 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-db50948c-0fee-4898-8908-43ca23ba194c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:30.353364 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-db50948c-0fee-4898-8908-43ca23ba194c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:30.354093 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-db50948c-0fee-4898-8908-43ca23ba194c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:30.354522 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-db50948c-0fee-4898-8908-43ca23ba194c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:30.355212 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-db50948c-0fee-4898-8908-43ca23ba194c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:30.356417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-db50948c-0fee-4898-8908-43ca23ba194c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:30.356417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-db50948c-0fee-4898-8908-43ca23ba194c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:30.628888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-db50948c-0fee-4898-8908-43ca23ba194c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:30.637010 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-db50948c-0fee-4898-8908-43ca23ba194c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:30.638514 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-db50948c-0fee-4898-8908-43ca23ba194c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:30.639698 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-db50948c-0fee-4898-8908-43ca23ba194c tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1721 microversion: 2.20 time: 0.297638 Aug 24 17:55:30.640240 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 414/801] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:30 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1721 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 17:55:31.669199 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-42d8e52c-6eb3-46f9-be76-069ea4f738be tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:31.669818 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-42d8e52c-6eb3-46f9-be76-069ea4f738be tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:31.682091 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-42d8e52c-6eb3-46f9-be76-069ea4f738be tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:31.682590 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-42d8e52c-6eb3-46f9-be76-069ea4f738be tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:31.683242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-42d8e52c-6eb3-46f9-be76-069ea4f738be tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:31.684247 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-42d8e52c-6eb3-46f9-be76-069ea4f738be tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:31.684697 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-42d8e52c-6eb3-46f9-be76-069ea4f738be tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:31.685147 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-42d8e52c-6eb3-46f9-be76-069ea4f738be tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:31.761737 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-42d8e52c-6eb3-46f9-be76-069ea4f738be tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:31.774076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-42d8e52c-6eb3-46f9-be76-069ea4f738be tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:31.775263 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-42d8e52c-6eb3-46f9-be76-069ea4f738be tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7813dcd78a38483682842ac199e1cd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe3fa5e280d4fbd8a26cac05fe8aaa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:31.782668 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-42d8e52c-6eb3-46f9-be76-069ea4f738be tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 200 len: 1654 microversion: 2.20 time: 0.124181 Aug 24 17:55:31.795502 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 388/802] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:31 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 1654 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 17:55:31.827392 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-ee16402d-370f-4c57-8c15-f7ea619d9651 req-b2b9479d-a15f-43b3-b2be-c311952bea5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34147b78-b9f5-4566-8d38-f0ed7ef27e7f", "name": "network-vif-deleted", "tag": "2ae11597-17eb-4280-8c34-d47ce491867b"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:31.841522 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ee16402d-370f-4c57-8c15-f7ea619d9651 req-b2b9479d-a15f-43b3-b2be-c311952bea5d service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:31.842265 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ee16402d-370f-4c57-8c15-f7ea619d9651 req-b2b9479d-a15f-43b3-b2be-c311952bea5d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:31.842882 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ee16402d-370f-4c57-8c15-f7ea619d9651 req-b2b9479d-a15f-43b3-b2be-c311952bea5d service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:31.864183 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-ee16402d-370f-4c57-8c15-f7ea619d9651 req-b2b9479d-a15f-43b3-b2be-c311952bea5d service nova] Creating event network-vif-deleted:2ae11597-17eb-4280-8c34-d47ce491867b for instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f on hv-cinder-84052 Aug 24 17:55:31.870448 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-ee16402d-370f-4c57-8c15-f7ea619d9651 req-b2b9479d-a15f-43b3-b2be-c311952bea5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046670 Aug 24 17:55:31.872312 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 415/803] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:32.808174 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c31fd5df-0890-437c-9309-7224fd6aeeb0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:32.808709 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c31fd5df-0890-437c-9309-7224fd6aeeb0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:32.816307 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c31fd5df-0890-437c-9309-7224fd6aeeb0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:32.816800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c31fd5df-0890-437c-9309-7224fd6aeeb0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:32.817234 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c31fd5df-0890-437c-9309-7224fd6aeeb0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:32.817998 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c31fd5df-0890-437c-9309-7224fd6aeeb0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:32.818456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c31fd5df-0890-437c-9309-7224fd6aeeb0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:32.818881 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c31fd5df-0890-437c-9309-7224fd6aeeb0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:32.834113 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-c31fd5df-0890-437c-9309-7224fd6aeeb0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] HTTP exception thrown: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c31fd5df-0890-437c-9309-7224fd6aeeb0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Request method failure captured: Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f HTTP/1.1 Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmRYbj-V9PjcwdHOh-YrC14MjM_RwDiPR3OMvmlu7Ii547sAHMvTX2niMRnBTHkxQvpheTsVtifPHTsOvUC82sGzsD1Xvk6kF5Z8uKjViARbKj5U5sOu9yM9d6N5Kop0yLFOwJubHKSgFQlw_w2hO66kFTUE8clp0257Klecr8hP4IY Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 2fe3fa5e280d4fbd8a26cac05fe8aaa9 Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:55:32.835832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:55:32.837488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}] Aug 24 17:55:32.837488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:32.837488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 2fe3fa5e280d4fbd8a26cac05fe8aaa9 Aug 24 17:55:32.837488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:32.837488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeShelveTestJSON-1674504252-project Aug 24 17:55:32.837488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:55:32.837488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:55:32.837488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 7813dcd78a38483682842ac199e1cd18 Aug 24 17:55:32.837488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674504252-project Aug 24 17:55:32.837488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:55:32.837488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:32.837488 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '34147b78-b9f5-4566-8d38-f0ed7ef27e7f'} Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:32.838356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:32.839993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:32.841111 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c31fd5df-0890-437c-9309-7224fd6aeeb0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Returning 404 to user: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:32.841111 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c31fd5df-0890-437c-9309-7224fd6aeeb0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 404 len: 111 microversion: 2.20 time: 0.034603 Aug 24 17:55:32.841111 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 389/804] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:32 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:55:32.848058 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e9b22a12-1c64-43c5-b688-050ec49c13c8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '.version_select at 0x7f4b29775a60>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:32.872128 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e9b22a12-1c64-43c5-b688-050ec49c13c8 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-149252560" status: 204 len: 0 microversion: 2.20 time: 0.028300 Aug 24 17:55:32.872712 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 416/805] 10.222.0.27 () {60 vars in 1259 bytes} [Wed Aug 24 17:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-149252560 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 17:55:34.853798 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f7131788-688e-42a2-ad13-8300df1b914a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:34.854309 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f7131788-688e-42a2-ad13-8300df1b914a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:34.860950 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f7131788-688e-42a2-ad13-8300df1b914a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:34.861441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f7131788-688e-42a2-ad13-8300df1b914a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:34.861883 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f7131788-688e-42a2-ad13-8300df1b914a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:34.862589 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f7131788-688e-42a2-ad13-8300df1b914a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:34.863150 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f7131788-688e-42a2-ad13-8300df1b914a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:34.863614 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f7131788-688e-42a2-ad13-8300df1b914a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:34.879881 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-f7131788-688e-42a2-ad13-8300df1b914a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] HTTP exception thrown: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f7131788-688e-42a2-ad13-8300df1b914a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Request method failure captured: Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: DELETE /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f HTTP/1.1 Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmRYbj-V9PjcwdHOh-YrC14MjM_RwDiPR3OMvmlu7Ii547sAHMvTX2niMRnBTHkxQvpheTsVtifPHTsOvUC82sGzsD1Xvk6kF5Z8uKjViARbKj5U5sOu9yM9d6N5Kop0yLFOwJubHKSgFQlw_w2hO66kFTUE8clp0257Klecr8hP4IY Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 2fe3fa5e280d4fbd8a26cac05fe8aaa9 Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:55:34.881474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:55:34.883224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}] Aug 24 17:55:34.883224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:34.883224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 2fe3fa5e280d4fbd8a26cac05fe8aaa9 Aug 24 17:55:34.883224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:34.883224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeShelveTestJSON-1674504252-project Aug 24 17:55:34.883224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:55:34.883224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:55:34.883224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 7813dcd78a38483682842ac199e1cd18 Aug 24 17:55:34.883224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674504252-project Aug 24 17:55:34.883224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:55:34.883224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:34.883224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '34147b78-b9f5-4566-8d38-f0ed7ef27e7f'} Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:34.884521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:34.886022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:34.887459 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f7131788-688e-42a2-ad13-8300df1b914a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Returning 404 to user: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:34.887459 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-f7131788-688e-42a2-ad13-8300df1b914a tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "DELETE /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 404 len: 111 microversion: 2.20 time: 0.032997 Aug 24 17:55:34.887459 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 390/806] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Aug 24 17:55:34 2022] DELETE /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:55:34.894166 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-641a8407-cb1c-40ec-a622-68228f6835c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:34.894938 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-641a8407-cb1c-40ec-a622-68228f6835c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 34147b78-b9f5-4566-8d38-f0ed7ef27e7f] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:34.901824 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-641a8407-cb1c-40ec-a622-68228f6835c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:34.902318 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-641a8407-cb1c-40ec-a622-68228f6835c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:34.902757 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-641a8407-cb1c-40ec-a622-68228f6835c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:34.903456 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-641a8407-cb1c-40ec-a622-68228f6835c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:34.903939 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-641a8407-cb1c-40ec-a622-68228f6835c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:34.904363 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-641a8407-cb1c-40ec-a622-68228f6835c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:34.918500 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-641a8407-cb1c-40ec-a622-68228f6835c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] HTTP exception thrown: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-641a8407-cb1c-40ec-a622-68228f6835c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Request method failure captured: Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f HTTP/1.1 Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmRYbj-V9PjcwdHOh-YrC14MjM_RwDiPR3OMvmlu7Ii547sAHMvTX2niMRnBTHkxQvpheTsVtifPHTsOvUC82sGzsD1Xvk6kF5Z8uKjViARbKj5U5sOu9yM9d6N5Kop0yLFOwJubHKSgFQlw_w2hO66kFTUE8clp0257Klecr8hP4IY Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 2fe3fa5e280d4fbd8a26cac05fe8aaa9 Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:55:34.920209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:55:34.921619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}] Aug 24 17:55:34.921619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:34.921619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 2fe3fa5e280d4fbd8a26cac05fe8aaa9 Aug 24 17:55:34.921619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:34.921619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-AttachVolumeShelveTestJSON-1674504252-project Aug 24 17:55:34.921619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:55:34.921619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:55:34.921619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 7813dcd78a38483682842ac199e1cd18 Aug 24 17:55:34.921619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674504252-project Aug 24 17:55:34.921619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:55:34.921619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:34.921619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '34147b78-b9f5-4566-8d38-f0ed7ef27e7f'} Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:34.922417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. Aug 24 17:55:34.924110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:34.926019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-641a8407-cb1c-40ec-a622-68228f6835c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Returning 404 to user: Instance 34147b78-b9f5-4566-8d38-f0ed7ef27e7f could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:34.926019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-641a8407-cb1c-40ec-a622-68228f6835c0 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f" status: 404 len: 111 microversion: 2.20 time: 0.032993 Aug 24 17:55:34.926019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 417/807] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:34 2022] GET /compute/v2.1/servers/34147b78-b9f5-4566-8d38-f0ed7ef27e7f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:55:36.106169 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f11293a9-4ab0-41b2-a0d1-c4291c7bf91b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:36.106719 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f11293a9-4ab0-41b2-a0d1-c4291c7bf91b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:36.113863 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f11293a9-4ab0-41b2-a0d1-c4291c7bf91b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:36.114565 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f11293a9-4ab0-41b2-a0d1-c4291c7bf91b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:36.115286 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f11293a9-4ab0-41b2-a0d1-c4291c7bf91b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:36.115933 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f11293a9-4ab0-41b2-a0d1-c4291c7bf91b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:36.116843 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f11293a9-4ab0-41b2-a0d1-c4291c7bf91b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:36.117460 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f11293a9-4ab0-41b2-a0d1-c4291c7bf91b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:36.132559 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-f11293a9-4ab0-41b2-a0d1-c4291c7bf91b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] HTTP exception thrown: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f11293a9-4ab0-41b2-a0d1-c4291c7bf91b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Request method failure captured: Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: DELETE /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c HTTP/1.1 Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmRYbj-V9PjcwdHOh-YrC14MjM_RwDiPR3OMvmlu7Ii547sAHMvTX2niMRnBTHkxQvpheTsVtifPHTsOvUC82sGzsD1Xvk6kF5Z8uKjViARbKj5U5sOu9yM9d6N5Kop0yLFOwJubHKSgFQlw_w2hO66kFTUE8clp0257Klecr8hP4IY Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 2fe3fa5e280d4fbd8a26cac05fe8aaa9 Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:55:36.134708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:55:36.136362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}] Aug 24 17:55:36.136362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:36.136362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 2fe3fa5e280d4fbd8a26cac05fe8aaa9 Aug 24 17:55:36.136362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:36.136362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeShelveTestJSON-1674504252-project Aug 24 17:55:36.136362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:55:36.136362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:55:36.136362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 7813dcd78a38483682842ac199e1cd18 Aug 24 17:55:36.136362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674504252-project Aug 24 17:55:36.136362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:55:36.136362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:55:36.136362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '11705238-e9d4-4c1e-ab49-d5a27eb4df4c'} Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:36.137246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:55:36.138621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:36.141602 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f11293a9-4ab0-41b2-a0d1-c4291c7bf91b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Returning 404 to user: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:36.142663 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-f11293a9-4ab0-41b2-a0d1-c4291c7bf91b tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "DELETE /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 404 len: 111 microversion: 2.20 time: 0.040565 Aug 24 17:55:36.143381 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 391/808] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Aug 24 17:55:36 2022] DELETE /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:55:36.152133 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-27b8950b-c411-4180-807a-b32018b74a63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:36.153041 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-27b8950b-c411-4180-807a-b32018b74a63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] [instance: 11705238-e9d4-4c1e-ab49-d5a27eb4df4c] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:36.160868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-27b8950b-c411-4180-807a-b32018b74a63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:36.161362 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-27b8950b-c411-4180-807a-b32018b74a63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:36.161810 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-27b8950b-c411-4180-807a-b32018b74a63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:36.162507 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-27b8950b-c411-4180-807a-b32018b74a63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:36.162962 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-27b8950b-c411-4180-807a-b32018b74a63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:36.163550 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-27b8950b-c411-4180-807a-b32018b74a63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:36.178265 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-27b8950b-c411-4180-807a-b32018b74a63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] HTTP exception thrown: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-27b8950b-c411-4180-807a-b32018b74a63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Request method failure captured: Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c HTTP/1.1 Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmRYbj-V9PjcwdHOh-YrC14MjM_RwDiPR3OMvmlu7Ii547sAHMvTX2niMRnBTHkxQvpheTsVtifPHTsOvUC82sGzsD1Xvk6kF5Z8uKjViARbKj5U5sOu9yM9d6N5Kop0yLFOwJubHKSgFQlw_w2hO66kFTUE8clp0257Klecr8hP4IY Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 2fe3fa5e280d4fbd8a26cac05fe8aaa9 Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:55:36.179849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:55:36.181431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2fe3fa5e280d4fbd8a26cac05fe8aaa9"}]}] Aug 24 17:55:36.181431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:36.181431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 2fe3fa5e280d4fbd8a26cac05fe8aaa9 Aug 24 17:55:36.181431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1674504252 Aug 24 17:55:36.181431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-AttachVolumeShelveTestJSON-1674504252-project Aug 24 17:55:36.181431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:55:36.181431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:55:36.181431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 7813dcd78a38483682842ac199e1cd18 Aug 24 17:55:36.181431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1674504252-project Aug 24 17:55:36.181431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:55:36.181431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:55:36.181431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '11705238-e9d4-4c1e-ab49-d5a27eb4df4c'} Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:36.182230 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. Aug 24 17:55:36.184974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:36.191287 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-27b8950b-c411-4180-807a-b32018b74a63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] Returning 404 to user: Instance 11705238-e9d4-4c1e-ab49-d5a27eb4df4c could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:36.191287 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-27b8950b-c411-4180-807a-b32018b74a63 tempest-AttachVolumeShelveTestJSON-1674504252 tempest-AttachVolumeShelveTestJSON-1674504252-project] 10.222.0.27 "GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c" status: 404 len: 111 microversion: 2.20 time: 0.033586 Aug 24 17:55:36.191287 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 418/809] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Aug 24 17:55:36 2022] GET /compute/v2.1/servers/11705238-e9d4-4c1e-ab49-d5a27eb4df4c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:55:42.117455 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2e14eda4-70fe-4746-a9bc-2563ad136bcb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:42.118053 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2e14eda4-70fe-4746-a9bc-2563ad136bcb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:42.125046 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2e14eda4-70fe-4746-a9bc-2563ad136bcb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.125552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2e14eda4-70fe-4746-a9bc-2563ad136bcb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.125986 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2e14eda4-70fe-4746-a9bc-2563ad136bcb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.126683 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2e14eda4-70fe-4746-a9bc-2563ad136bcb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.127138 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2e14eda4-70fe-4746-a9bc-2563ad136bcb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.127586 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2e14eda4-70fe-4746-a9bc-2563ad136bcb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.154661 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2e14eda4-70fe-4746-a9bc-2563ad136bcb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2/ips" status: 200 len: 150 microversion: 2.1 time: 0.041037 Aug 24 17:55:42.167897 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fc1dbeea-29ec-46f6-94ba-db2fce0410b9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "080ffc66-28d1-443f-9699-50ad0569b3f1"}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:42.168608 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 392/810] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 17:55:42 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:42.170872 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-fc1dbeea-29ec-46f6-94ba-db2fce0410b9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:42.178012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fc1dbeea-29ec-46f6-94ba-db2fce0410b9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.178505 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fc1dbeea-29ec-46f6-94ba-db2fce0410b9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.178928 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fc1dbeea-29ec-46f6-94ba-db2fce0410b9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.179672 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fc1dbeea-29ec-46f6-94ba-db2fce0410b9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.180138 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fc1dbeea-29ec-46f6-94ba-db2fce0410b9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.180563 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-fc1dbeea-29ec-46f6-94ba-db2fce0410b9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.275770 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-fc1dbeea-29ec-46f6-94ba-db2fce0410b9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Invalid volume: volume 080ffc66-28d1-443f-9699-50ad0569b3f1 is already attached to instances: 2e207e34-6199-4650-9358-5ef1fd30774a Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fc1dbeea-29ec-46f6-94ba-db2fce0410b9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: POST /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2/os-volume_attachments HTTP/1.1 Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 74 Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:55:42.277411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:55:42.278817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:55:42.278817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:55:42.278817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:55:42.278817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:55:42.278817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:55:42.278817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:55:42.278817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:55:42.278817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:55:42.278817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:55:42.278817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Aug 24 17:55:42.278817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {"volumeAttachment": {"volumeId": "080ffc66-28d1-443f-9699-50ad0569b3f1"}} Aug 24 17:55:42.278817 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Invalid volume: volume 080ffc66-28d1-443f-9699-50ad0569b3f1 is already attached to instances: 2e207e34-6199-4650-9358-5ef1fd30774a Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'server_id': 'dd9880c9-7222-4fa9-a5f0-2dbca7500cf2', 'body': {'volumeAttachment': {'volumeId': '080ffc66-28d1-443f-9699-50ad0569b3f1'}}} Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 080ffc66-28d1-443f-9699-50ad0569b3f1 is already attached to instances: 2e207e34-6199-4650-9358-5ef1fd30774a Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:42.280033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 080ffc66-28d1-443f-9699-50ad0569b3f1 is already attached to instances: 2e207e34-6199-4650-9358-5ef1fd30774a Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:42.281855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:42.283097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:42.283097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:42.283097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:42.283097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 080ffc66-28d1-443f-9699-50ad0569b3f1 is already attached to instances: 2e207e34-6199-4650-9358-5ef1fd30774a Aug 24 17:55:42.283097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:42.283097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fc1dbeea-29ec-46f6-94ba-db2fce0410b9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 400 to user: Invalid volume: volume 080ffc66-28d1-443f-9699-50ad0569b3f1 is already attached to instances: 2e207e34-6199-4650-9358-5ef1fd30774a {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:42.283097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-fc1dbeea-29ec-46f6-94ba-db2fce0410b9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115403 Aug 24 17:55:42.283097 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 419/811] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:55:42 2022] POST /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2/os-volume_attachments => generated 174 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 17:55:42.289465 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ae910f3c-a3e5-414f-a8b7-6034982a6b8e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:42.290245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ae910f3c-a3e5-414f-a8b7-6034982a6b8e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:42.297622 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ae910f3c-a3e5-414f-a8b7-6034982a6b8e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.298462 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ae910f3c-a3e5-414f-a8b7-6034982a6b8e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.299112 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ae910f3c-a3e5-414f-a8b7-6034982a6b8e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.300200 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ae910f3c-a3e5-414f-a8b7-6034982a6b8e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.300773 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ae910f3c-a3e5-414f-a8b7-6034982a6b8e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.301710 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ae910f3c-a3e5-414f-a8b7-6034982a6b8e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.328843 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ae910f3c-a3e5-414f-a8b7-6034982a6b8e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:55:42.413887 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ae910f3c-a3e5-414f-a8b7-6034982a6b8e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 204 len: 0 microversion: 2.1 time: 0.127973 Aug 24 17:55:42.414690 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 393/812] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:55:42 2022] DELETE /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:55:42.423878 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-bebef297-5068-4e7d-89df-8820da62b462 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:42.424728 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-bebef297-5068-4e7d-89df-8820da62b462 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:42.431736 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bebef297-5068-4e7d-89df-8820da62b462 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.432571 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bebef297-5068-4e7d-89df-8820da62b462 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.433186 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bebef297-5068-4e7d-89df-8820da62b462 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.434054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bebef297-5068-4e7d-89df-8820da62b462 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:42.434666 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bebef297-5068-4e7d-89df-8820da62b462 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:42.435447 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bebef297-5068-4e7d-89df-8820da62b462 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:42.661939 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bebef297-5068-4e7d-89df-8820da62b462 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:42.670565 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-bebef297-5068-4e7d-89df-8820da62b462 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1681 microversion: 2.1 time: 0.251252 Aug 24 17:55:42.671189 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 420/813] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:42 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1681 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:43.694972 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4fb6152f-0f94-4070-909a-90a1f4e3525f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:43.696479 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4fb6152f-0f94-4070-909a-90a1f4e3525f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:43.704356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4fb6152f-0f94-4070-909a-90a1f4e3525f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:43.705339 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4fb6152f-0f94-4070-909a-90a1f4e3525f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:43.706035 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4fb6152f-0f94-4070-909a-90a1f4e3525f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:43.707108 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4fb6152f-0f94-4070-909a-90a1f4e3525f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:43.707844 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4fb6152f-0f94-4070-909a-90a1f4e3525f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:43.709008 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4fb6152f-0f94-4070-909a-90a1f4e3525f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:43.911374 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4fb6152f-0f94-4070-909a-90a1f4e3525f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:43.936246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4fb6152f-0f94-4070-909a-90a1f4e3525f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1681 microversion: 2.1 time: 0.247628 Aug 24 17:55:43.938817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 394/814] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:43 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1681 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:44.960351 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4a0e9a8c-fd2c-4c72-a9c8-ea372f28517d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:44.960968 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4a0e9a8c-fd2c-4c72-a9c8-ea372f28517d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:44.968885 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4a0e9a8c-fd2c-4c72-a9c8-ea372f28517d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:44.969376 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4a0e9a8c-fd2c-4c72-a9c8-ea372f28517d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:44.969807 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4a0e9a8c-fd2c-4c72-a9c8-ea372f28517d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:44.972832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4a0e9a8c-fd2c-4c72-a9c8-ea372f28517d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:44.973504 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4a0e9a8c-fd2c-4c72-a9c8-ea372f28517d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:44.974101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4a0e9a8c-fd2c-4c72-a9c8-ea372f28517d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:45.088986 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-0aa26029-130c-405f-bac4-6226d1b9cf2f req-8cda5e3a-da62-45c7-b141-d865440e19bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9880c9-7222-4fa9-a5f0-2dbca7500cf2", "name": "network-vif-deleted", "tag": "6c39b813-4893-4572-b87a-9cfa16992682"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:45.103826 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4a0e9a8c-fd2c-4c72-a9c8-ea372f28517d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:45.106335 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-0aa26029-130c-405f-bac4-6226d1b9cf2f req-8cda5e3a-da62-45c7-b141-d865440e19bc service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:45.109200 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-0aa26029-130c-405f-bac4-6226d1b9cf2f req-8cda5e3a-da62-45c7-b141-d865440e19bc service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:45.110006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-0aa26029-130c-405f-bac4-6226d1b9cf2f req-8cda5e3a-da62-45c7-b141-d865440e19bc service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:45.117695 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4a0e9a8c-fd2c-4c72-a9c8-ea372f28517d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 200 len: 1614 microversion: 2.1 time: 0.161081 Aug 24 17:55:45.126589 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 421/815] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:44 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 1614 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:45.126840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-0aa26029-130c-405f-bac4-6226d1b9cf2f req-8cda5e3a-da62-45c7-b141-d865440e19bc service nova] Creating event network-vif-deleted:6c39b813-4893-4572-b87a-9cfa16992682 for instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 on hv-cinder-84052 Aug 24 17:55:45.134406 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-0aa26029-130c-405f-bac4-6226d1b9cf2f req-8cda5e3a-da62-45c7-b141-d865440e19bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054055 Aug 24 17:55:45.135635 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 395/816] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:45.908420 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4dcfcc2b-9f35-400f-91f2-2a935ccc238c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Action: 'create', calling method: .version_select at 0x7f4b297ba700>, body: {"keypair": {"name": "tempest-keypair-1219266933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHymbiNJXASnF4aCsw5mHxpRkFF4hDLZghuer2dEge2Q7nV5dJZ76Xka3afYAoXLVfo/XAvmPPVTAii7VTQqnnegCjDN6UuZA4woapm1YBtWHcC9o2ACnfxsNh3VheLU0A=="}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:45.927001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-4dcfcc2b-9f35-400f-91f2-2a935ccc238c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Getting quotas for project 1422bbfed9414b8cada1656aed195a31. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:55:45.931473 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-4dcfcc2b-9f35-400f-91f2-2a935ccc238c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Getting quotas for user 1daca2cfac58487189f1fe8bf4bcb130 and project 1422bbfed9414b8cada1656aed195a31. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:55:45.958332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4dcfcc2b-9f35-400f-91f2-2a935ccc238c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178554 Aug 24 17:55:45.959162 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 422/817] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 17:55:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:46.141676 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b17eff91-704d-4048-99ab-a96b06437b2e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:46.142980 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b17eff91-704d-4048-99ab-a96b06437b2e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:46.149660 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b17eff91-704d-4048-99ab-a96b06437b2e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:46.150158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b17eff91-704d-4048-99ab-a96b06437b2e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:46.150647 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b17eff91-704d-4048-99ab-a96b06437b2e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:46.151343 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b17eff91-704d-4048-99ab-a96b06437b2e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:46.151845 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b17eff91-704d-4048-99ab-a96b06437b2e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:46.152273 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b17eff91-704d-4048-99ab-a96b06437b2e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:46.168329 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-b17eff91-704d-4048-99ab-a96b06437b2e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b17eff91-704d-4048-99ab-a96b06437b2e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 HTTP/1.1 Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:55:46.170143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:55:46.171739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:55:46.171739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:55:46.171739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:55:46.171739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:55:46.171739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:55:46.171739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:55:46.171739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:55:46.171739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:55:46.171739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:55:46.171739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:55:46.171739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:55:46.171739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': 'dd9880c9-7222-4fa9-a5f0-2dbca7500cf2'} Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:46.172553 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:55:46.173817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:46.174987 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b17eff91-704d-4048-99ab-a96b06437b2e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 404 to user: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:46.175635 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b17eff91-704d-4048-99ab-a96b06437b2e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 404 len: 111 microversion: 2.1 time: 0.035442 Aug 24 17:55:46.176516 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 396/818] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:46 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:55:46.185635 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-834981c7-fa19-4f7d-85f6-8586d7acfb2d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '.version_select at 0x7f4b2986e550>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:46.214475 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-834981c7-fa19-4f7d-85f6-8586d7acfb2d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-689567904" status: 202 len: 0 microversion: 2.1 time: 0.033254 Aug 24 17:55:46.216014 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 423/819] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Aug 24 17:55:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-689567904 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:55:47.027025 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1dc42790-0a8c-41ce-9bc2-778a670c6a68 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:47.027828 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1dc42790-0a8c-41ce-9bc2-778a670c6a68 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:47.035096 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1dc42790-0a8c-41ce-9bc2-778a670c6a68 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.035947 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1dc42790-0a8c-41ce-9bc2-778a670c6a68 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.036636 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1dc42790-0a8c-41ce-9bc2-778a670c6a68 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.037578 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1dc42790-0a8c-41ce-9bc2-778a670c6a68 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.038269 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1dc42790-0a8c-41ce-9bc2-778a670c6a68 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.038934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1dc42790-0a8c-41ce-9bc2-778a670c6a68 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.148947 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-1dc42790-0a8c-41ce-9bc2-778a670c6a68 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lazy-loading 'services' on Instance uuid 2e207e34-6199-4650-9358-5ef1fd30774a {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:55:47.154439 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:47.244019 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1dc42790-0a8c-41ce-9bc2-778a670c6a68 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a/os-volume_attachments/080ffc66-28d1-443f-9699-50ad0569b3f1" status: 202 len: 0 microversion: 2.1 time: 0.220548 Aug 24 17:55:47.245448 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 397/820] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 17:55:47 2022] DELETE /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a/os-volume_attachments/080ffc66-28d1-443f-9699-50ad0569b3f1 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:55:47.253481 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-10ef5e9e-e5c5-4e1c-8ca8-4a292f85f3a5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:47.256291 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-10ef5e9e-e5c5-4e1c-8ca8-4a292f85f3a5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:47.267628 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10ef5e9e-e5c5-4e1c-8ca8-4a292f85f3a5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.268734 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10ef5e9e-e5c5-4e1c-8ca8-4a292f85f3a5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.269436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10ef5e9e-e5c5-4e1c-8ca8-4a292f85f3a5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.271265 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10ef5e9e-e5c5-4e1c-8ca8-4a292f85f3a5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:47.271953 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10ef5e9e-e5c5-4e1c-8ca8-4a292f85f3a5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:47.273077 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-10ef5e9e-e5c5-4e1c-8ca8-4a292f85f3a5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:47.312606 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-10ef5e9e-e5c5-4e1c-8ca8-4a292f85f3a5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062774 Aug 24 17:55:47.313496 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 424/821] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:55:47 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:47.753642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1045569803", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29fbbcf6-c646-4aae-ba1c-126437193f4d"}], "security_groups": [{"name": "tempest-securitygroup--203137999"}], "key_name": "tempest-keypair-1219266933", "user_data": "}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:47.866860 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] validate_networks() for [('29fbbcf6-c646-4aae-ba1c-126437193f4d', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:55:48.295548 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:55:48.296156 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:55:48.296476 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:55:48.296888 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:55:48.297303 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:55:48.306210 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.306693 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.307131 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.307893 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.308353 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.308779 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.325379 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b27d1b4d-4622-4fc3-83d4-60414bb17d26 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:48.331108 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b27d1b4d-4622-4fc3-83d4-60414bb17d26 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:48.337993 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Getting quotas for project 1422bbfed9414b8cada1656aed195a31. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:55:48.338314 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b27d1b4d-4622-4fc3-83d4-60414bb17d26 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.338803 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b27d1b4d-4622-4fc3-83d4-60414bb17d26 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.339245 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b27d1b4d-4622-4fc3-83d4-60414bb17d26 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.339970 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b27d1b4d-4622-4fc3-83d4-60414bb17d26 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.340634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b27d1b4d-4622-4fc3-83d4-60414bb17d26 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.341062 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b27d1b4d-4622-4fc3-83d4-60414bb17d26 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.342398 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Getting quotas for user 1daca2cfac58487189f1fe8bf4bcb130 and project 1422bbfed9414b8cada1656aed195a31. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:55:48.354527 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:55:48.357072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:55:48.372792 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b27d1b4d-4622-4fc3-83d4-60414bb17d26 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050928 Aug 24 17:55:48.379128 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 425/822] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:55:48 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:55:48.408903 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-31ee3aae-1c15-4dbc-bcf8-8c716d1b408f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.663444 Aug 24 17:55:48.409547 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 398/823] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:55:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:55:48.428963 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-759731ac-3dd5-4483-8006-aa4650e756db tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:48.429586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-759731ac-3dd5-4483-8006-aa4650e756db tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:48.453049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-aa25c45e-9b89-4325-a80c-3b6b91ecdd73 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:48.453828 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-aa25c45e-9b89-4325-a80c-3b6b91ecdd73 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:48.461215 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-aa25c45e-9b89-4325-a80c-3b6b91ecdd73 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.461984 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-aa25c45e-9b89-4325-a80c-3b6b91ecdd73 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.462632 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-aa25c45e-9b89-4325-a80c-3b6b91ecdd73 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.463657 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-aa25c45e-9b89-4325-a80c-3b6b91ecdd73 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.464303 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-aa25c45e-9b89-4325-a80c-3b6b91ecdd73 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.464915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-aa25c45e-9b89-4325-a80c-3b6b91ecdd73 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.493357 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-aa25c45e-9b89-4325-a80c-3b6b91ecdd73 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:55:48.503176 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-759731ac-3dd5-4483-8006-aa4650e756db tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:48.511965 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-759731ac-3dd5-4483-8006-aa4650e756db tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1238 microversion: 2.1 time: 0.094465 Aug 24 17:55:48.512770 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 426/824] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:48 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:48.598930 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-aa25c45e-9b89-4325-a80c-3b6b91ecdd73 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 204 len: 0 microversion: 2.1 time: 0.150009 Aug 24 17:55:48.599685 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 399/825] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:55:48 2022] DELETE /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:55:48.609069 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-21b1a4f8-acde-47d1-b209-59e1605917d2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:48.609706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-21b1a4f8-acde-47d1-b209-59e1605917d2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:48.616694 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21b1a4f8-acde-47d1-b209-59e1605917d2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.617526 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21b1a4f8-acde-47d1-b209-59e1605917d2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.618320 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21b1a4f8-acde-47d1-b209-59e1605917d2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.619208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21b1a4f8-acde-47d1-b209-59e1605917d2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:48.619719 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21b1a4f8-acde-47d1-b209-59e1605917d2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:48.620152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-21b1a4f8-acde-47d1-b209-59e1605917d2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:48.778504 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-21b1a4f8-acde-47d1-b209-59e1605917d2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:48.783565 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:48.789573 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-21b1a4f8-acde-47d1-b209-59e1605917d2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1682 microversion: 2.1 time: 0.185681 Aug 24 17:55:48.790697 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 427/826] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:48 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:49.534123 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-48a6d107-3b70-4527-94d8-ca41af98a6d9 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:49.534836 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-48a6d107-3b70-4527-94d8-ca41af98a6d9 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:49.541278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-48a6d107-3b70-4527-94d8-ca41af98a6d9 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:49.541765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-48a6d107-3b70-4527-94d8-ca41af98a6d9 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:49.542206 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-48a6d107-3b70-4527-94d8-ca41af98a6d9 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:49.542901 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-48a6d107-3b70-4527-94d8-ca41af98a6d9 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:49.543359 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-48a6d107-3b70-4527-94d8-ca41af98a6d9 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:49.543816 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-48a6d107-3b70-4527-94d8-ca41af98a6d9 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:49.607069 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-48a6d107-3b70-4527-94d8-ca41af98a6d9 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:49.615235 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-48a6d107-3b70-4527-94d8-ca41af98a6d9 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1242 microversion: 2.1 time: 0.085391 Aug 24 17:55:49.615831 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 400/827] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:49 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:49.811993 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-bb94e51d-fa21-4a13-84c6-e3042717e2e7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:49.812609 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-bb94e51d-fa21-4a13-84c6-e3042717e2e7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:49.820128 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bb94e51d-fa21-4a13-84c6-e3042717e2e7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:49.820614 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bb94e51d-fa21-4a13-84c6-e3042717e2e7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:49.821052 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bb94e51d-fa21-4a13-84c6-e3042717e2e7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:49.821749 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bb94e51d-fa21-4a13-84c6-e3042717e2e7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:49.822203 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bb94e51d-fa21-4a13-84c6-e3042717e2e7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:49.822624 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bb94e51d-fa21-4a13-84c6-e3042717e2e7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:49.955022 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bb94e51d-fa21-4a13-84c6-e3042717e2e7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:49.962704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-bb94e51d-fa21-4a13-84c6-e3042717e2e7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1682 microversion: 2.1 time: 0.154982 Aug 24 17:55:49.963298 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 428/828] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:49 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:50.636296 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0776ccff-7ec3-4e3f-916b-6e54e3799b6f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:50.638015 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0776ccff-7ec3-4e3f-916b-6e54e3799b6f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:50.645323 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0776ccff-7ec3-4e3f-916b-6e54e3799b6f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:50.645820 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0776ccff-7ec3-4e3f-916b-6e54e3799b6f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:50.646255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0776ccff-7ec3-4e3f-916b-6e54e3799b6f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:50.646983 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0776ccff-7ec3-4e3f-916b-6e54e3799b6f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:50.647643 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0776ccff-7ec3-4e3f-916b-6e54e3799b6f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:50.648268 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0776ccff-7ec3-4e3f-916b-6e54e3799b6f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:50.751543 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0776ccff-7ec3-4e3f-916b-6e54e3799b6f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:50.759077 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0776ccff-7ec3-4e3f-916b-6e54e3799b6f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1296 microversion: 2.1 time: 0.126684 Aug 24 17:55:50.759673 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 401/829] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:50 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1296 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:50.984709 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d355ec83-e83d-4d92-9542-9ef2d4667720 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:50.985383 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d355ec83-e83d-4d92-9542-9ef2d4667720 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:50.992191 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d355ec83-e83d-4d92-9542-9ef2d4667720 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:50.992709 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d355ec83-e83d-4d92-9542-9ef2d4667720 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:50.993183 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d355ec83-e83d-4d92-9542-9ef2d4667720 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:50.993886 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d355ec83-e83d-4d92-9542-9ef2d4667720 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:50.994495 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d355ec83-e83d-4d92-9542-9ef2d4667720 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:50.994956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d355ec83-e83d-4d92-9542-9ef2d4667720 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:51.135405 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d355ec83-e83d-4d92-9542-9ef2d4667720 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:51.143262 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d355ec83-e83d-4d92-9542-9ef2d4667720 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1682 microversion: 2.1 time: 0.162906 Aug 24 17:55:51.143859 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 429/830] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:50 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:51.781681 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-32e4eb0f-fdcd-4b2f-8e39-5d9b7e9c58cd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:51.782294 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-32e4eb0f-fdcd-4b2f-8e39-5d9b7e9c58cd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:51.788902 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-32e4eb0f-fdcd-4b2f-8e39-5d9b7e9c58cd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:51.789399 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-32e4eb0f-fdcd-4b2f-8e39-5d9b7e9c58cd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:51.789839 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-32e4eb0f-fdcd-4b2f-8e39-5d9b7e9c58cd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:51.790632 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-32e4eb0f-fdcd-4b2f-8e39-5d9b7e9c58cd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:51.790986 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-32e4eb0f-fdcd-4b2f-8e39-5d9b7e9c58cd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:51.791408 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-32e4eb0f-fdcd-4b2f-8e39-5d9b7e9c58cd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:51.868149 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-32e4eb0f-fdcd-4b2f-8e39-5d9b7e9c58cd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:51.876919 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-32e4eb0f-fdcd-4b2f-8e39-5d9b7e9c58cd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1296 microversion: 2.1 time: 0.099503 Aug 24 17:55:51.877331 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 402/831] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:51 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:51.979158 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-ad90b240-2f16-4104-a330-57222014c1ac req-fcbc2fab-6b80-4d94-8b09-cb5d1f16589b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e207e34-6199-4650-9358-5ef1fd30774a", "name": "network-vif-deleted", "tag": "8c02114c-93ee-4d8c-9f80-148768e58b93"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:52.046205 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:52.058283 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ad90b240-2f16-4104-a330-57222014c1ac req-fcbc2fab-6b80-4d94-8b09-cb5d1f16589b service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:52.060982 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ad90b240-2f16-4104-a330-57222014c1ac req-fcbc2fab-6b80-4d94-8b09-cb5d1f16589b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:52.062590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ad90b240-2f16-4104-a330-57222014c1ac req-fcbc2fab-6b80-4d94-8b09-cb5d1f16589b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:52.114332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-ad90b240-2f16-4104-a330-57222014c1ac req-fcbc2fab-6b80-4d94-8b09-cb5d1f16589b service nova] Creating event network-vif-deleted:8c02114c-93ee-4d8c-9f80-148768e58b93 for instance 2e207e34-6199-4650-9358-5ef1fd30774a on hv-cinder-84052 Aug 24 17:55:52.141885 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-ad90b240-2f16-4104-a330-57222014c1ac req-fcbc2fab-6b80-4d94-8b09-cb5d1f16589b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171727 Aug 24 17:55:52.144429 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 430/832] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:52.166119 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:52.166743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:52.173875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:52.174606 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:52.175245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:52.180049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:52.180739 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:52.181891 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:52.256565 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:52.257329 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:52.258152 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:52.258845 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lazy-loading 'fault' on Instance uuid 2e207e34-6199-4650-9358-5ef1fd30774a {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:55:52.458413 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:52.473800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8b744e57-b351-4511-b6ef-4f7071a6c808 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 200 len: 1331 microversion: 2.1 time: 0.312382 Aug 24 17:55:52.478103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 403/833] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:52 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 1331 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:52.808540 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-52995174-d5c6-4057-89a3-5fe1348531e5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:52.809508 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-52995174-d5c6-4057-89a3-5fe1348531e5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:52.825445 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-52995174-d5c6-4057-89a3-5fe1348531e5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:52.833012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-659d1e95-4d27-4bb1-be1a-a71df24d1648 req-9555a2e5-f9bf-4a79-9dac-12e6845a3a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa859353-b309-4c9b-8f43-21b185b4f27d", "tag": "8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:52.838862 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-52995174-d5c6-4057-89a3-5fe1348531e5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:52.842781 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-52995174-d5c6-4057-89a3-5fe1348531e5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:52.844166 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-52995174-d5c6-4057-89a3-5fe1348531e5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:52.846012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:52.846292 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-52995174-d5c6-4057-89a3-5fe1348531e5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:52.847981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-52995174-d5c6-4057-89a3-5fe1348531e5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:52.876452 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-659d1e95-4d27-4bb1-be1a-a71df24d1648 req-9555a2e5-f9bf-4a79-9dac-12e6845a3a46 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:52.879382 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-659d1e95-4d27-4bb1-be1a-a71df24d1648 req-9555a2e5-f9bf-4a79-9dac-12e6845a3a46 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:52.882634 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-659d1e95-4d27-4bb1-be1a-a71df24d1648 req-9555a2e5-f9bf-4a79-9dac-12e6845a3a46 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:52.912026 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-659d1e95-4d27-4bb1-be1a-a71df24d1648 req-9555a2e5-f9bf-4a79-9dac-12e6845a3a46 service nova] Creating event network-changed:8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba for instance aa859353-b309-4c9b-8f43-21b185b4f27d on hv-cinder-84052 Aug 24 17:55:52.927137 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-52995174-d5c6-4057-89a3-5fe1348531e5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Going to try to terminate instance {{(pid=126994) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:55:52.929359 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-659d1e95-4d27-4bb1-be1a-a71df24d1648 req-9555a2e5-f9bf-4a79-9dac-12e6845a3a46 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099816 Aug 24 17:55:52.930085 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 404/834] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:55:52.948020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-dd40eeab-24f5-441e-a15b-71038b6f929e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:52.948758 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-dd40eeab-24f5-441e-a15b-71038b6f929e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:52.966445 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dd40eeab-24f5-441e-a15b-71038b6f929e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:52.967358 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dd40eeab-24f5-441e-a15b-71038b6f929e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:52.977256 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dd40eeab-24f5-441e-a15b-71038b6f929e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:52.978187 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dd40eeab-24f5-441e-a15b-71038b6f929e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:52.979123 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dd40eeab-24f5-441e-a15b-71038b6f929e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:52.979594 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-dd40eeab-24f5-441e-a15b-71038b6f929e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:53.084850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-52995174-d5c6-4057-89a3-5fe1348531e5 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "DELETE /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 204 len: 0 microversion: 2.1 time: 0.280155 Aug 24 17:55:53.085932 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 431/835] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:55:52 2022] DELETE /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:55:53.096692 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a6fa86c2-c94b-42b8-8c0a-c52e77d02d40 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:53.098153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a6fa86c2-c94b-42b8-8c0a-c52e77d02d40 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:53.104616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a6fa86c2-c94b-42b8-8c0a-c52e77d02d40 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:53.105382 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a6fa86c2-c94b-42b8-8c0a-c52e77d02d40 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:53.105923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a6fa86c2-c94b-42b8-8c0a-c52e77d02d40 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:53.106904 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a6fa86c2-c94b-42b8-8c0a-c52e77d02d40 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:53.107468 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a6fa86c2-c94b-42b8-8c0a-c52e77d02d40 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:53.108590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a6fa86c2-c94b-42b8-8c0a-c52e77d02d40 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:53.273056 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a6fa86c2-c94b-42b8-8c0a-c52e77d02d40 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:53.282878 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a6fa86c2-c94b-42b8-8c0a-c52e77d02d40 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.191684 Aug 24 17:55:53.298506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 432/836] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:53 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:53.322103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-dd40eeab-24f5-441e-a15b-71038b6f929e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:53.330700 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-dd40eeab-24f5-441e-a15b-71038b6f929e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1363 microversion: 2.1 time: 0.398095 Aug 24 17:55:53.331275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 405/837] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:52 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1363 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:53.494898 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-96fe4f9b-a6ff-4b6e-b8c9-565bc991e639 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:53.495992 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-96fe4f9b-a6ff-4b6e-b8c9-565bc991e639 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:53.502909 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96fe4f9b-a6ff-4b6e-b8c9-565bc991e639 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:53.503405 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96fe4f9b-a6ff-4b6e-b8c9-565bc991e639 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:53.503963 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96fe4f9b-a6ff-4b6e-b8c9-565bc991e639 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:53.504674 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96fe4f9b-a6ff-4b6e-b8c9-565bc991e639 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:53.505225 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96fe4f9b-a6ff-4b6e-b8c9-565bc991e639 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:53.505795 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-96fe4f9b-a6ff-4b6e-b8c9-565bc991e639 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:53.522968 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-96fe4f9b-a6ff-4b6e-b8c9-565bc991e639 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-96fe4f9b-a6ff-4b6e-b8c9-565bc991e639 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a HTTP/1.1 Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:55:53.524868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:55:53.526278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:55:53.526278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:55:53.526278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:55:53.526278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:55:53.526278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:55:53.526278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:55:53.526278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:55:53.526278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:55:53.526278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:55:53.526278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:55:53.526278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:55:53.526278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '2e207e34-6199-4650-9358-5ef1fd30774a'} Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:53.527310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:55:53.528586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:55:53.529704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-96fe4f9b-a6ff-4b6e-b8c9-565bc991e639 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 404 to user: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:53.529704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-96fe4f9b-a6ff-4b6e-b8c9-565bc991e639 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 404 len: 111 microversion: 2.1 time: 0.035303 Aug 24 17:55:53.529704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 433/838] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:53 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:55:53.535754 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e2028e5b-9f2b-4d17-aa22-0422a1e2c0dc tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '.version_select at 0x7f4b296e6550>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:53.555921 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e2028e5b-9f2b-4d17-aa22-0422a1e2c0dc tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601424484" status: 202 len: 0 microversion: 2.1 time: 0.024029 Aug 24 17:55:53.556502 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 406/839] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 24 17:55:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601424484 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:55:54.206415 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-924be8a4-b228-4d47-8969-68f6c7a7a5c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: .version_select at 0x7f4b29795040>, body: {"keypair": {"name": "tempest-keypair-1089162182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9ktboqGuKMj2hZU/837qyIXGcQ6itDj+UpG3ucg/Xf1Zag4TtX+jEXUfztVW55gW+6PsIEs5BdZywQX9SmyVbRhAN68cm0E4t+yxr+xZi5UBeGsvTHHQchqYTk0SOuBA=="}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:54.207633 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-44a33f49-e142-4a36-9621-e3d156ae7bcc req-a145c9ea-798c-40b3-93d7-d269b3107f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbbd365-963e-4126-835c-d2a1725dfd77", "tag": "1bd0f31f-109e-44d3-a9ca-645f8d269396"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:54.218617 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-44a33f49-e142-4a36-9621-e3d156ae7bcc req-a145c9ea-798c-40b3-93d7-d269b3107f0a service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:54.219102 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-44a33f49-e142-4a36-9621-e3d156ae7bcc req-a145c9ea-798c-40b3-93d7-d269b3107f0a service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:54.219578 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-44a33f49-e142-4a36-9621-e3d156ae7bcc req-a145c9ea-798c-40b3-93d7-d269b3107f0a service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:54.224631 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-924be8a4-b228-4d47-8969-68f6c7a7a5c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for project 625652cfa47248faac8c1f7759c56a14. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:55:54.228482 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-924be8a4-b228-4d47-8969-68f6c7a7a5c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for user d8b9d2b042c04927b9115085fcb4ba40 and project 625652cfa47248faac8c1f7759c56a14. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:55:54.229834 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-44a33f49-e142-4a36-9621-e3d156ae7bcc req-a145c9ea-798c-40b3-93d7-d269b3107f0a service nova] Creating event network-changed:1bd0f31f-109e-44d3-a9ca-645f8d269396 for instance 1fbbd365-963e-4126-835c-d2a1725dfd77 on hv-cinder-84052 Aug 24 17:55:54.234674 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-44a33f49-e142-4a36-9621-e3d156ae7bcc req-a145c9ea-798c-40b3-93d7-d269b3107f0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031269 Aug 24 17:55:54.235256 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 407/840] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:54.250799 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-924be8a4-b228-4d47-8969-68f6c7a7a5c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050600 Aug 24 17:55:54.251315 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 434/841] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 17:55:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:54.305911 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-94f96a84-5f08-4b95-b9e5-bb6f42a7a624 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:54.306720 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-94f96a84-5f08-4b95-b9e5-bb6f42a7a624 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:54.313837 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-94f96a84-5f08-4b95-b9e5-bb6f42a7a624 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:54.314400 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-94f96a84-5f08-4b95-b9e5-bb6f42a7a624 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:54.314840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-94f96a84-5f08-4b95-b9e5-bb6f42a7a624 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:54.315568 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-94f96a84-5f08-4b95-b9e5-bb6f42a7a624 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:54.316028 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-94f96a84-5f08-4b95-b9e5-bb6f42a7a624 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:54.316457 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-94f96a84-5f08-4b95-b9e5-bb6f42a7a624 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:54.351099 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-e8ed9ee9-4f1c-4d17-9aed-ade86d77f042 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:54.351786 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-e8ed9ee9-4f1c-4d17-9aed-ade86d77f042 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:54.358620 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e8ed9ee9-4f1c-4d17-9aed-ade86d77f042 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:54.359247 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e8ed9ee9-4f1c-4d17-9aed-ade86d77f042 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:54.359746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e8ed9ee9-4f1c-4d17-9aed-ade86d77f042 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:54.360450 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e8ed9ee9-4f1c-4d17-9aed-ade86d77f042 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:54.360907 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e8ed9ee9-4f1c-4d17-9aed-ade86d77f042 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:54.361333 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-e8ed9ee9-4f1c-4d17-9aed-ade86d77f042 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:54.496602 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-e8ed9ee9-4f1c-4d17-9aed-ade86d77f042 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:54.505047 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-e8ed9ee9-4f1c-4d17-9aed-ade86d77f042 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1363 microversion: 2.1 time: 0.158113 Aug 24 17:55:54.505541 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 435/842] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:54 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:54.631675 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-94f96a84-5f08-4b95-b9e5-bb6f42a7a624 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:54.639661 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-94f96a84-5f08-4b95-b9e5-bb6f42a7a624 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1567 microversion: 2.1 time: 0.337910 Aug 24 17:55:54.653253 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 408/843] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:54 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1567 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:55.034324 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-0e541e73-a5a5-4e69-afc6-39445fa9a50b req-58e24d4c-11ee-47ec-8eb9-ca3d0bf2d1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa859353-b309-4c9b-8f43-21b185b4f27d", "name": "network-vif-deleted", "tag": "8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:55.050958 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-0e541e73-a5a5-4e69-afc6-39445fa9a50b req-58e24d4c-11ee-47ec-8eb9-ca3d0bf2d1dc service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:55.051570 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-0e541e73-a5a5-4e69-afc6-39445fa9a50b req-58e24d4c-11ee-47ec-8eb9-ca3d0bf2d1dc service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:55.052357 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-0e541e73-a5a5-4e69-afc6-39445fa9a50b req-58e24d4c-11ee-47ec-8eb9-ca3d0bf2d1dc service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:55.068860 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-0e541e73-a5a5-4e69-afc6-39445fa9a50b req-58e24d4c-11ee-47ec-8eb9-ca3d0bf2d1dc service nova] Creating event network-vif-deleted:8d36b8ea-fbfc-42ac-bfb3-fae1fd335dba for instance aa859353-b309-4c9b-8f43-21b185b4f27d on hv-cinder-84052 Aug 24 17:55:55.078691 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-0e541e73-a5a5-4e69-afc6-39445fa9a50b req-58e24d4c-11ee-47ec-8eb9-ca3d0bf2d1dc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048414 Aug 24 17:55:55.080332 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 436/844] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:55:55.526567 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9066a3c3-591f-4af1-802c-2e609a3ed23a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:55.527188 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9066a3c3-591f-4af1-802c-2e609a3ed23a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:55.534657 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9066a3c3-591f-4af1-802c-2e609a3ed23a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:55.535388 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9066a3c3-591f-4af1-802c-2e609a3ed23a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:55.535855 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9066a3c3-591f-4af1-802c-2e609a3ed23a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:55.536559 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9066a3c3-591f-4af1-802c-2e609a3ed23a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:55.537015 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9066a3c3-591f-4af1-802c-2e609a3ed23a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:55.537442 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9066a3c3-591f-4af1-802c-2e609a3ed23a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:55.662231 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f0635460-91d7-46cb-b7ee-8930f28ef74b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:55.662935 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f0635460-91d7-46cb-b7ee-8930f28ef74b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:55.669875 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f0635460-91d7-46cb-b7ee-8930f28ef74b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:55.670356 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f0635460-91d7-46cb-b7ee-8930f28ef74b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:55.670786 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f0635460-91d7-46cb-b7ee-8930f28ef74b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:55.671543 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f0635460-91d7-46cb-b7ee-8930f28ef74b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:55.671998 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f0635460-91d7-46cb-b7ee-8930f28ef74b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:55.672416 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f0635460-91d7-46cb-b7ee-8930f28ef74b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:55.740517 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f0635460-91d7-46cb-b7ee-8930f28ef74b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c75bb50ad7704e66983959d338b48e27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ef0ce1ee884e9d80d4200d40b7b6c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:55.749091 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f0635460-91d7-46cb-b7ee-8930f28ef74b tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 200 len: 1218 microversion: 2.1 time: 0.090900 Aug 24 17:55:55.749762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 437/845] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:55 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:55.768914 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9066a3c3-591f-4af1-802c-2e609a3ed23a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:55.777455 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9066a3c3-591f-4af1-802c-2e609a3ed23a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1363 microversion: 2.1 time: 0.254697 Aug 24 17:55:55.778725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 409/846] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:55 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:56.371501 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-323164476", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87807a97-d368-4c81-a10c-4e62e5ebdb01"}], "security_groups": [{"name": "tempest-securitygroup--1455289557"}], "key_name": "tempest-keypair-1089162182", "user_data": "}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:55:56.487072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.network.neutron [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] validate_networks() for [('87807a97-d368-4c81-a10c-4e62e5ebdb01', None, None, None, None, None)] {{(pid=126994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:55:56.770761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a3cf21c6-8fe9-4b3f-871f-96f703f43574 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:56.771378 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a3cf21c6-8fe9-4b3f-871f-96f703f43574 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] [instance: aa859353-b309-4c9b-8f43-21b185b4f27d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:56.778061 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a3cf21c6-8fe9-4b3f-871f-96f703f43574 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:56.778540 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a3cf21c6-8fe9-4b3f-871f-96f703f43574 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:56.778976 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a3cf21c6-8fe9-4b3f-871f-96f703f43574 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:56.780192 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a3cf21c6-8fe9-4b3f-871f-96f703f43574 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:56.780653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a3cf21c6-8fe9-4b3f-871f-96f703f43574 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:56.781067 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a3cf21c6-8fe9-4b3f-871f-96f703f43574 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:56.796637 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-a3cf21c6-8fe9-4b3f-871f-96f703f43574 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] HTTP exception thrown: Instance aa859353-b309-4c9b-8f43-21b185b4f27d could not be found. Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a3cf21c6-8fe9-4b3f-871f-96f703f43574 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Request method failure captured: Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d HTTP/1.1 Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmTrJPNX2Fy4thHONkNSvUXW7ZDItTQvTrdqH28uoqB8KTcI33ns7dxO0gBwql9wB8q9Es1JGtP2nrHlQzQid-qoLtMbz09hD3DSbcu7TIeeBL_fgYI2mCn-qtdugBDTkV3l2GuY6y0x0lOPwxXrQoBJqbJzjE62aT_9XWWMwbE6fPY Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 79ef0ce1ee884e9d80d4200d40b7b6c2 Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-TestShelveInstance-598556735 Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:55:56.798277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:55:56.799982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/79ef0ce1ee884e9d80d4200d40b7b6c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ef0ce1ee884e9d80d4200d40b7b6c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/79ef0ce1ee884e9d80d4200d40b7b6c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_79ef0ce1ee884e9d80d4200d40b7b6c2"}]}] Aug 24 17:55:56.799982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-TestShelveInstance-598556735 Aug 24 17:55:56.799982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 79ef0ce1ee884e9d80d4200d40b7b6c2 Aug 24 17:55:56.799982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-TestShelveInstance-598556735 Aug 24 17:55:56.799982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-TestShelveInstance-598556735-project Aug 24 17:55:56.799982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:55:56.799982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:55:56.799982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: c75bb50ad7704e66983959d338b48e27 Aug 24 17:55:56.799982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-TestShelveInstance-598556735-project Aug 24 17:55:56.799982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:55:56.799982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance aa859353-b309-4c9b-8f43-21b185b4f27d could not be found. Aug 24 17:55:56.799982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': 'aa859353-b309-4c9b-8f43-21b185b4f27d'} Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa859353-b309-4c9b-8f43-21b185b4f27d could not be found. Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:55:56.800934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa859353-b309-4c9b-8f43-21b185b4f27d could not be found. Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa859353-b309-4c9b-8f43-21b185b4f27d could not be found. Aug 24 17:55:56.802813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:55:56.805294 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a3cf21c6-8fe9-4b3f-871f-96f703f43574 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Returning 404 to user: Instance aa859353-b309-4c9b-8f43-21b185b4f27d could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:55:56.805294 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a3cf21c6-8fe9-4b3f-871f-96f703f43574 tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d" status: 404 len: 111 microversion: 2.1 time: 0.032908 Aug 24 17:55:56.805294 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 410/847] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:56 2022] GET /compute/v2.1/servers/aa859353-b309-4c9b-8f43-21b185b4f27d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:55:56.807782 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b0f9a222-cdaa-4097-a466-278bade1568e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:56.808392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b0f9a222-cdaa-4097-a466-278bade1568e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:56.814418 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b0f9a222-cdaa-4097-a466-278bade1568e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:56.814901 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b0f9a222-cdaa-4097-a466-278bade1568e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:56.815389 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b0f9a222-cdaa-4097-a466-278bade1568e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:56.816061 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b0f9a222-cdaa-4097-a466-278bade1568e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:56.816510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b0f9a222-cdaa-4097-a466-278bade1568e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:56.816930 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b0f9a222-cdaa-4097-a466-278bade1568e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:56.906167 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Flavor limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:55:56.906675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Image limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:55:56.907057 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Flavor pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:55:56.907470 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Image pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:55:56.907906 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:55:56.916668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:56.917149 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:56.917586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:56.918312 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:56.918763 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:56.919185 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:56.937787 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for project 625652cfa47248faac8c1f7759c56a14. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:55:56.941856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for user d8b9d2b042c04927b9115085fcb4ba40 and project 625652cfa47248faac8c1f7759c56a14. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:55:56.955980 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Going to run 1 instances... {{(pid=126994) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:55:56.959812 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:55:57.014015 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-19813628-38f8-4a07-a6e6-55f671eae32a tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.647146 Aug 24 17:55:57.015512 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 438/848] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:55:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:55:57.017279 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b0f9a222-cdaa-4097-a466-278bade1568e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:57.028389 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-68930eb7-cea9-4b49-b88b-062f26aeef5e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:57.030264 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-68930eb7-cea9-4b49-b88b-062f26aeef5e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:57.036416 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b0f9a222-cdaa-4097-a466-278bade1568e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1363 microversion: 2.1 time: 0.230243 Aug 24 17:55:57.039392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 411/849] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:56 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:57.068373 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6141ba85-4f21-4890-8c94-da9cbdec8a3a tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] Calling method '.version_select at 0x7f4b296c4700>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:57.092562 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6141ba85-4f21-4890-8c94-da9cbdec8a3a tempest-TestShelveInstance-598556735 tempest-TestShelveInstance-598556735-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-768140014" status: 202 len: 0 microversion: 2.1 time: 0.028059 Aug 24 17:55:57.094841 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 412/850] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 17:55:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-768140014 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:55:57.106669 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-68930eb7-cea9-4b49-b88b-062f26aeef5e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:57.118453 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-68930eb7-cea9-4b49-b88b-062f26aeef5e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1241 microversion: 2.1 time: 0.095811 Aug 24 17:55:57.119289 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 439/851] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:57 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:58.061902 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-fd31f4cf-e3b8-4b57-8c5a-50818bce32ab tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:58.062522 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-fd31f4cf-e3b8-4b57-8c5a-50818bce32ab tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:58.084115 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd31f4cf-e3b8-4b57-8c5a-50818bce32ab tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:58.084868 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd31f4cf-e3b8-4b57-8c5a-50818bce32ab tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:58.085638 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd31f4cf-e3b8-4b57-8c5a-50818bce32ab tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:58.086524 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd31f4cf-e3b8-4b57-8c5a-50818bce32ab tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:58.086992 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd31f4cf-e3b8-4b57-8c5a-50818bce32ab tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:58.087418 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd31f4cf-e3b8-4b57-8c5a-50818bce32ab tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:58.143156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9fbb713c-a508-44b8-8b7d-14ee75880206 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:58.143949 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9fbb713c-a508-44b8-8b7d-14ee75880206 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:58.150858 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9fbb713c-a508-44b8-8b7d-14ee75880206 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:58.151660 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9fbb713c-a508-44b8-8b7d-14ee75880206 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:58.152401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9fbb713c-a508-44b8-8b7d-14ee75880206 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:58.153511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9fbb713c-a508-44b8-8b7d-14ee75880206 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:58.154170 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9fbb713c-a508-44b8-8b7d-14ee75880206 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:58.154794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9fbb713c-a508-44b8-8b7d-14ee75880206 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:58.255101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9fbb713c-a508-44b8-8b7d-14ee75880206 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:58.269092 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9fbb713c-a508-44b8-8b7d-14ee75880206 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1311 microversion: 2.1 time: 0.129692 Aug 24 17:55:58.270729 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 440/852] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:58 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1311 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:58.317787 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:58.349842 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=6 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:55:58.378500 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-fd31f4cf-e3b8-4b57-8c5a-50818bce32ab tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:58.387698 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-fd31f4cf-e3b8-4b57-8c5a-50818bce32ab tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1363 microversion: 2.1 time: 0.330662 Aug 24 17:55:58.389539 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 413/853] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:58 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1363 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:59.290271 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8a9b7bce-168c-45e2-802d-ab783a3b7951 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:59.290894 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8a9b7bce-168c-45e2-802d-ab783a3b7951 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:59.304223 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8a9b7bce-168c-45e2-802d-ab783a3b7951 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:59.304854 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8a9b7bce-168c-45e2-802d-ab783a3b7951 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:59.305307 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8a9b7bce-168c-45e2-802d-ab783a3b7951 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:59.306032 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8a9b7bce-168c-45e2-802d-ab783a3b7951 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:59.306496 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8a9b7bce-168c-45e2-802d-ab783a3b7951 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:59.306925 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8a9b7bce-168c-45e2-802d-ab783a3b7951 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:59.410043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-39876ce2-056e-461f-97d8-6035628fbde0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:55:59.411311 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-39876ce2-056e-461f-97d8-6035628fbde0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:55:59.421132 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-39876ce2-056e-461f-97d8-6035628fbde0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:59.421984 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-39876ce2-056e-461f-97d8-6035628fbde0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:59.422590 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-39876ce2-056e-461f-97d8-6035628fbde0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:59.427328 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-39876ce2-056e-461f-97d8-6035628fbde0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:55:59.428354 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-39876ce2-056e-461f-97d8-6035628fbde0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:55:59.429091 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-39876ce2-056e-461f-97d8-6035628fbde0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:55:59.534506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8a9b7bce-168c-45e2-802d-ab783a3b7951 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:59.545117 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8a9b7bce-168c-45e2-802d-ab783a3b7951 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1367 microversion: 2.1 time: 0.258548 Aug 24 17:55:59.545849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 441/854] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:59 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:55:59.668958 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-39876ce2-056e-461f-97d8-6035628fbde0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:55:59.677856 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-39876ce2-056e-461f-97d8-6035628fbde0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1363 microversion: 2.1 time: 0.271721 Aug 24 17:55:59.678456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 414/855] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:55:59 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:55:59.970771 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-6891cf99-c6df-4ff8-bf87-eb080862df3f req-39cc87d0-3bd9-4522-9a73-53b48e2ec749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "887986a8-3a8d-4a88-8aa4-a97a16e391ac", "tag": "56f3b43c-0345-4a96-8783-3b7d326dd2cf"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:00.010321 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-6891cf99-c6df-4ff8-bf87-eb080862df3f req-39cc87d0-3bd9-4522-9a73-53b48e2ec749 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:00.014751 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-6891cf99-c6df-4ff8-bf87-eb080862df3f req-39cc87d0-3bd9-4522-9a73-53b48e2ec749 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:00.016180 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-6891cf99-c6df-4ff8-bf87-eb080862df3f req-39cc87d0-3bd9-4522-9a73-53b48e2ec749 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:00.032838 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-34228a54-22f5-4994-85df-b31835bf0cea req-d56fc5bf-75f6-4fa8-a319-332ce0c5fcfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbbd365-963e-4126-835c-d2a1725dfd77", "name": "network-vif-plugged", "status": "completed", "tag": "1bd0f31f-109e-44d3-a9ca-645f8d269396"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:00.051917 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-34228a54-22f5-4994-85df-b31835bf0cea req-d56fc5bf-75f6-4fa8-a319-332ce0c5fcfc service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:00.052493 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-6891cf99-c6df-4ff8-bf87-eb080862df3f req-39cc87d0-3bd9-4522-9a73-53b48e2ec749 service nova] Creating event network-changed:56f3b43c-0345-4a96-8783-3b7d326dd2cf for instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac on hv-cinder-84052 Aug 24 17:56:00.052798 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-34228a54-22f5-4994-85df-b31835bf0cea req-d56fc5bf-75f6-4fa8-a319-332ce0c5fcfc service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:00.054210 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-34228a54-22f5-4994-85df-b31835bf0cea req-d56fc5bf-75f6-4fa8-a319-332ce0c5fcfc service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:00.067275 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-6891cf99-c6df-4ff8-bf87-eb080862df3f req-39cc87d0-3bd9-4522-9a73-53b48e2ec749 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105318 Aug 24 17:56:00.072534 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 442/856] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:00.081769 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-34228a54-22f5-4994-85df-b31835bf0cea req-d56fc5bf-75f6-4fa8-a319-332ce0c5fcfc service nova] Creating event network-vif-plugged:1bd0f31f-109e-44d3-a9ca-645f8d269396 for instance 1fbbd365-963e-4126-835c-d2a1725dfd77 on hv-cinder-84052 Aug 24 17:56:00.097395 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-34228a54-22f5-4994-85df-b31835bf0cea req-d56fc5bf-75f6-4fa8-a319-332ce0c5fcfc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068135 Aug 24 17:56:00.098574 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 415/857] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:56:00.567140 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3ac66b7b-6c38-4492-8ccf-9fe9c1d3ab11 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:00.567863 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3ac66b7b-6c38-4492-8ccf-9fe9c1d3ab11 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:00.574603 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ac66b7b-6c38-4492-8ccf-9fe9c1d3ab11 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:00.575094 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ac66b7b-6c38-4492-8ccf-9fe9c1d3ab11 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:00.575828 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ac66b7b-6c38-4492-8ccf-9fe9c1d3ab11 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:00.576562 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ac66b7b-6c38-4492-8ccf-9fe9c1d3ab11 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:00.577020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ac66b7b-6c38-4492-8ccf-9fe9c1d3ab11 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:00.577450 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ac66b7b-6c38-4492-8ccf-9fe9c1d3ab11 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:00.703219 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0e383638-0bca-4fe3-9d54-e23027756927 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:00.703991 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0e383638-0bca-4fe3-9d54-e23027756927 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:00.715162 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e383638-0bca-4fe3-9d54-e23027756927 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:00.715702 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e383638-0bca-4fe3-9d54-e23027756927 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:00.716143 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e383638-0bca-4fe3-9d54-e23027756927 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:00.716852 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e383638-0bca-4fe3-9d54-e23027756927 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:00.717915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e383638-0bca-4fe3-9d54-e23027756927 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:00.718348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0e383638-0bca-4fe3-9d54-e23027756927 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:00.839702 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3ac66b7b-6c38-4492-8ccf-9fe9c1d3ab11 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:00.848930 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3ac66b7b-6c38-4492-8ccf-9fe9c1d3ab11 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1367 microversion: 2.1 time: 0.286078 Aug 24 17:56:00.849622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 443/858] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:00 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:00.863471 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-0e383638-0bca-4fe3-9d54-e23027756927 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:00.872606 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0e383638-0bca-4fe3-9d54-e23027756927 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1363 microversion: 2.1 time: 0.176123 Aug 24 17:56:00.882275 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 416/859] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:00 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:56:01.874795 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7e9cacaf-2b99-4998-8fe4-c1c7d8fbe401 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:01.876055 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7e9cacaf-2b99-4998-8fe4-c1c7d8fbe401 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:01.882773 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e9cacaf-2b99-4998-8fe4-c1c7d8fbe401 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:01.883559 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e9cacaf-2b99-4998-8fe4-c1c7d8fbe401 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:01.884161 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e9cacaf-2b99-4998-8fe4-c1c7d8fbe401 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:01.884871 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e9cacaf-2b99-4998-8fe4-c1c7d8fbe401 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:01.885490 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e9cacaf-2b99-4998-8fe4-c1c7d8fbe401 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:01.885912 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e9cacaf-2b99-4998-8fe4-c1c7d8fbe401 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:01.895996 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-130a5f6c-2719-4bea-bc98-689634200daf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:01.897462 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-130a5f6c-2719-4bea-bc98-689634200daf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:01.908102 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-130a5f6c-2719-4bea-bc98-689634200daf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:01.908964 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-130a5f6c-2719-4bea-bc98-689634200daf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:01.909608 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-130a5f6c-2719-4bea-bc98-689634200daf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:01.910552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-130a5f6c-2719-4bea-bc98-689634200daf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:01.911216 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-130a5f6c-2719-4bea-bc98-689634200daf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:01.911878 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-130a5f6c-2719-4bea-bc98-689634200daf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:01.945206 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:02.049593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7e9cacaf-2b99-4998-8fe4-c1c7d8fbe401 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:02.058163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7e9cacaf-2b99-4998-8fe4-c1c7d8fbe401 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1367 microversion: 2.1 time: 0.187244 Aug 24 17:56:02.059697 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 444/860] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:01 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:02.167572 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-130a5f6c-2719-4bea-bc98-689634200daf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:02.176757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-130a5f6c-2719-4bea-bc98-689634200daf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1363 microversion: 2.1 time: 0.285016 Aug 24 17:56:02.177644 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 417/861] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:01 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:56:03.080581 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c65d3415-b7d3-4252-ad55-e06e0b72fb03 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:03.084923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c65d3415-b7d3-4252-ad55-e06e0b72fb03 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:03.102417 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c65d3415-b7d3-4252-ad55-e06e0b72fb03 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:03.102973 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c65d3415-b7d3-4252-ad55-e06e0b72fb03 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:03.103409 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c65d3415-b7d3-4252-ad55-e06e0b72fb03 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:03.104143 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c65d3415-b7d3-4252-ad55-e06e0b72fb03 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:03.104593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c65d3415-b7d3-4252-ad55-e06e0b72fb03 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:03.105037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c65d3415-b7d3-4252-ad55-e06e0b72fb03 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:03.196716 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-723bf80b-0771-454d-a4fb-054e1da72a35 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:03.197321 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-723bf80b-0771-454d-a4fb-054e1da72a35 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:03.205400 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-723bf80b-0771-454d-a4fb-054e1da72a35 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:03.205896 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-723bf80b-0771-454d-a4fb-054e1da72a35 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:03.206339 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-723bf80b-0771-454d-a4fb-054e1da72a35 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:03.207232 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-723bf80b-0771-454d-a4fb-054e1da72a35 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:03.207734 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-723bf80b-0771-454d-a4fb-054e1da72a35 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:03.208164 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-723bf80b-0771-454d-a4fb-054e1da72a35 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:03.361661 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-723bf80b-0771-454d-a4fb-054e1da72a35 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:03.373867 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-723bf80b-0771-454d-a4fb-054e1da72a35 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1550 microversion: 2.1 time: 0.180541 Aug 24 17:56:03.374441 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 418/862] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:03 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1550 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:56:03.395419 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-26130614-a89d-4992-9229-7128fdffaf11 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:03.395693 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-26130614-a89d-4992-9229-7128fdffaf11 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:03.405056 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c65d3415-b7d3-4252-ad55-e06e0b72fb03 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:03.411404 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-26130614-a89d-4992-9229-7128fdffaf11 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:03.412258 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-26130614-a89d-4992-9229-7128fdffaf11 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:03.412937 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-26130614-a89d-4992-9229-7128fdffaf11 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:03.414183 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-26130614-a89d-4992-9229-7128fdffaf11 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:03.416072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-26130614-a89d-4992-9229-7128fdffaf11 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:03.416732 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-26130614-a89d-4992-9229-7128fdffaf11 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:03.428656 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c65d3415-b7d3-4252-ad55-e06e0b72fb03 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1367 microversion: 2.1 time: 0.353228 Aug 24 17:56:03.430729 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 445/863] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:03 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:03.518902 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-26130614-a89d-4992-9229-7128fdffaf11 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128070 Aug 24 17:56:03.520413 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 419/864] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 17:56:03 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:56:04.449612 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-540281b6-843d-482d-9a17-ba60c1282c2b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:04.450886 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-540281b6-843d-482d-9a17-ba60c1282c2b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:04.458053 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-540281b6-843d-482d-9a17-ba60c1282c2b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:04.458615 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-540281b6-843d-482d-9a17-ba60c1282c2b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:04.459797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-540281b6-843d-482d-9a17-ba60c1282c2b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:04.460567 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-540281b6-843d-482d-9a17-ba60c1282c2b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:04.461215 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-540281b6-843d-482d-9a17-ba60c1282c2b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:04.461829 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-540281b6-843d-482d-9a17-ba60c1282c2b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:04.682759 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-1570f8f6-a3a4-4682-b7f9-ddfd66ca7433 req-2ff2ac3f-46e4-4cc4-bf4a-fe9af56c1824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbbd365-963e-4126-835c-d2a1725dfd77", "tag": "1bd0f31f-109e-44d3-a9ca-645f8d269396"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:04.701829 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-1570f8f6-a3a4-4682-b7f9-ddfd66ca7433 req-2ff2ac3f-46e4-4cc4-bf4a-fe9af56c1824 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:04.706436 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-1570f8f6-a3a4-4682-b7f9-ddfd66ca7433 req-2ff2ac3f-46e4-4cc4-bf4a-fe9af56c1824 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:04.707095 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-1570f8f6-a3a4-4682-b7f9-ddfd66ca7433 req-2ff2ac3f-46e4-4cc4-bf4a-fe9af56c1824 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:04.717459 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-540281b6-843d-482d-9a17-ba60c1282c2b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:04.725254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-540281b6-843d-482d-9a17-ba60c1282c2b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1367 microversion: 2.1 time: 0.279446 Aug 24 17:56:04.726408 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 446/865] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:04 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:04.730799 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-1570f8f6-a3a4-4682-b7f9-ddfd66ca7433 req-2ff2ac3f-46e4-4cc4-bf4a-fe9af56c1824 service nova] Creating event network-changed:1bd0f31f-109e-44d3-a9ca-645f8d269396 for instance 1fbbd365-963e-4126-835c-d2a1725dfd77 on hv-cinder-84052 Aug 24 17:56:04.736462 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-1570f8f6-a3a4-4682-b7f9-ddfd66ca7433 req-2ff2ac3f-46e4-4cc4-bf4a-fe9af56c1824 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058717 Aug 24 17:56:04.739693 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 420/866] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:56:05.746329 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-22d4684c-05aa-418c-9d12-663db8dfedf0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:05.747171 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-22d4684c-05aa-418c-9d12-663db8dfedf0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:05.754298 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-22d4684c-05aa-418c-9d12-663db8dfedf0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:05.754791 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-22d4684c-05aa-418c-9d12-663db8dfedf0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:05.755577 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-22d4684c-05aa-418c-9d12-663db8dfedf0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:05.756287 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-22d4684c-05aa-418c-9d12-663db8dfedf0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:05.756735 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-22d4684c-05aa-418c-9d12-663db8dfedf0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:05.757304 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-22d4684c-05aa-418c-9d12-663db8dfedf0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:06.150908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-312aead8-e758-44eb-9124-3beb38ca1456 req-535ef041-6483-40a7-a9b5-998cd71e1b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "887986a8-3a8d-4a88-8aa4-a97a16e391ac", "name": "network-vif-plugged", "status": "completed", "tag": "56f3b43c-0345-4a96-8783-3b7d326dd2cf"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:06.168223 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-312aead8-e758-44eb-9124-3beb38ca1456 req-535ef041-6483-40a7-a9b5-998cd71e1b63 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:06.170182 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-312aead8-e758-44eb-9124-3beb38ca1456 req-535ef041-6483-40a7-a9b5-998cd71e1b63 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:06.170999 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-312aead8-e758-44eb-9124-3beb38ca1456 req-535ef041-6483-40a7-a9b5-998cd71e1b63 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:06.192353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-22d4684c-05aa-418c-9d12-663db8dfedf0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:06.202778 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-22d4684c-05aa-418c-9d12-663db8dfedf0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1367 microversion: 2.1 time: 0.460239 Aug 24 17:56:06.211619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-312aead8-e758-44eb-9124-3beb38ca1456 req-535ef041-6483-40a7-a9b5-998cd71e1b63 service nova] Creating event network-vif-plugged:56f3b43c-0345-4a96-8783-3b7d326dd2cf for instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac on hv-cinder-84052 Aug 24 17:56:06.214406 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 447/867] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:05 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1367 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:06.218183 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-312aead8-e758-44eb-9124-3beb38ca1456 req-535ef041-6483-40a7-a9b5-998cd71e1b63 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122503 Aug 24 17:56:06.219027 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 421/868] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:07.225326 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-2210463a-5f04-44b3-9021-03b77f863eb0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:07.225946 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-2210463a-5f04-44b3-9021-03b77f863eb0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:07.228364 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:07.229077 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=18 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:07.235110 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2210463a-5f04-44b3-9021-03b77f863eb0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:07.235623 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2210463a-5f04-44b3-9021-03b77f863eb0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:07.236064 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2210463a-5f04-44b3-9021-03b77f863eb0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:07.236755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2210463a-5f04-44b3-9021-03b77f863eb0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:07.237212 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2210463a-5f04-44b3-9021-03b77f863eb0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:07.237637 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2210463a-5f04-44b3-9021-03b77f863eb0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:07.241847 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:07.367070 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-2210463a-5f04-44b3-9021-03b77f863eb0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:07.375545 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-2210463a-5f04-44b3-9021-03b77f863eb0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1367 microversion: 2.1 time: 0.154027 Aug 24 17:56:07.376114 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 448/869] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:07 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:08.397557 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8734924d-d313-45eb-a67e-38afb64e08c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:08.398248 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8734924d-d313-45eb-a67e-38afb64e08c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:08.405012 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8734924d-d313-45eb-a67e-38afb64e08c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:08.405490 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8734924d-d313-45eb-a67e-38afb64e08c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:08.405917 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8734924d-d313-45eb-a67e-38afb64e08c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:08.406600 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8734924d-d313-45eb-a67e-38afb64e08c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:08.407051 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8734924d-d313-45eb-a67e-38afb64e08c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:08.407465 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8734924d-d313-45eb-a67e-38afb64e08c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:08.536692 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8734924d-d313-45eb-a67e-38afb64e08c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:08.544424 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8734924d-d313-45eb-a67e-38afb64e08c3 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1557 microversion: 2.1 time: 0.151700 Aug 24 17:56:08.544992 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 422/870] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:08 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:08.565076 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a4bb0932-335e-4292-9b17-8de25fb857dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:08.565591 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a4bb0932-335e-4292-9b17-8de25fb857dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:08.572243 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a4bb0932-335e-4292-9b17-8de25fb857dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:08.572758 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a4bb0932-335e-4292-9b17-8de25fb857dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:08.573194 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a4bb0932-335e-4292-9b17-8de25fb857dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:08.573889 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a4bb0932-335e-4292-9b17-8de25fb857dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:08.574347 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a4bb0932-335e-4292-9b17-8de25fb857dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:08.574772 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a4bb0932-335e-4292-9b17-8de25fb857dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:08.653269 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a4bb0932-335e-4292-9b17-8de25fb857dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092781 Aug 24 17:56:08.653889 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 449/871] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 17:56:08 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:09.607139 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-da26decc-b3b2-4e2e-b47b-35854408c663 req-e50addb5-0c02-4f91-8e62-8d3112567873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "887986a8-3a8d-4a88-8aa4-a97a16e391ac", "tag": "56f3b43c-0345-4a96-8783-3b7d326dd2cf"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:09.623096 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-da26decc-b3b2-4e2e-b47b-35854408c663 req-e50addb5-0c02-4f91-8e62-8d3112567873 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:09.623672 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-da26decc-b3b2-4e2e-b47b-35854408c663 req-e50addb5-0c02-4f91-8e62-8d3112567873 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:09.624101 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-da26decc-b3b2-4e2e-b47b-35854408c663 req-e50addb5-0c02-4f91-8e62-8d3112567873 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:09.636341 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-da26decc-b3b2-4e2e-b47b-35854408c663 req-e50addb5-0c02-4f91-8e62-8d3112567873 service nova] Creating event network-changed:56f3b43c-0345-4a96-8783-3b7d326dd2cf for instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac on hv-cinder-84052 Aug 24 17:56:09.645740 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-da26decc-b3b2-4e2e-b47b-35854408c663 req-e50addb5-0c02-4f91-8e62-8d3112567873 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042317 Aug 24 17:56:09.646677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 423/872] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:56:34.207640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:34.208453 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=8 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:34.212597 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-757865462", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1899728589", "security_groups": [{"name": "tempest-secgroup-smoke-1035260104"}], "block_device_mapping_v2": [{"uuid": "f7a8bf9f-1675-4a73-a884-cbc1256e64e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "670b2ce6-025e-49c8-81a1-b5bd33c90dee"}]}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:34.326957 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.network.neutron [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] validate_networks() for [('670b2ce6-025e-49c8-81a1-b5bd33c90dee', None, None, None, None, None)] {{(pid=126994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:56:34.693967 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Flavor limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:56:34.694391 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Image limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:56:34.694864 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Flavor pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:56:34.695268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Image pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:56:34.695850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:56:34.704933 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:34.705411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:34.705844 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:34.706564 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:34.707016 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:34.707438 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:34.724714 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Getting quotas for project b9cd3cd0a9434f5ab0e1e1c52145beb2. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:56:34.728623 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Getting quotas for user 4279761de1464be38860432a46a89074 and project b9cd3cd0a9434f5ab0e1e1c52145beb2. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:56:34.784864 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Going to run 1 instances... {{(pid=126994) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:56:34.786975 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f7a8bf9f-1675-4a73-a884-cbc1256e64e1',volume_size=None,volume_type=None)] {{(pid=126994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:56:34.912301 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-519ef90d-dd59-47f1-943a-8e7a1263dd69 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706093 Aug 24 17:56:34.919139 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 450/873] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:56:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:56:34.924836 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c1c3b634-2dca-49ce-b94d-a7ad992c1fdc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:34.925799 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c1c3b634-2dca-49ce-b94d-a7ad992c1fdc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:34.944257 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:34.945126 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=24 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:35.001341 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c1c3b634-2dca-49ce-b94d-a7ad992c1fdc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:35.008655 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c1c3b634-2dca-49ce-b94d-a7ad992c1fdc tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1094 microversion: 2.1 time: 0.087860 Aug 24 17:56:35.009221 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 424/874] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:34 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1094 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:36.029996 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-2409c4de-a463-49c5-b15b-d801555b5e62 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:36.030771 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-2409c4de-a463-49c5-b15b-d801555b5e62 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:36.038386 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2409c4de-a463-49c5-b15b-d801555b5e62 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:36.038886 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2409c4de-a463-49c5-b15b-d801555b5e62 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:36.039363 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2409c4de-a463-49c5-b15b-d801555b5e62 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:36.040159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2409c4de-a463-49c5-b15b-d801555b5e62 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:36.040647 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2409c4de-a463-49c5-b15b-d801555b5e62 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:36.041059 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2409c4de-a463-49c5-b15b-d801555b5e62 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:36.108509 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-2409c4de-a463-49c5-b15b-d801555b5e62 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:36.116105 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-2409c4de-a463-49c5-b15b-d801555b5e62 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1210 microversion: 2.1 time: 0.090937 Aug 24 17:56:36.116676 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 451/875] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:36 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:37.137821 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-bc1faa69-08aa-4ea4-9446-98a9b858385d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:37.138429 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-bc1faa69-08aa-4ea4-9446-98a9b858385d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:37.145624 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc1faa69-08aa-4ea4-9446-98a9b858385d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:37.146135 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc1faa69-08aa-4ea4-9446-98a9b858385d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:37.146564 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc1faa69-08aa-4ea4-9446-98a9b858385d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:37.147255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc1faa69-08aa-4ea4-9446-98a9b858385d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:37.147732 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc1faa69-08aa-4ea4-9446-98a9b858385d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:37.148152 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-bc1faa69-08aa-4ea4-9446-98a9b858385d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:37.252045 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-ea40961b-ca96-4ee9-a14a-96af83ea3138 req-9c768e90-2df1-417e-ae9b-bc02d51ffcaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c6c085-c660-42cf-90ce-069f9ecfc17d", "tag": "206a6ecc-a9ba-4d78-b340-8f29b89a766a"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:37.262573 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ea40961b-ca96-4ee9-a14a-96af83ea3138 req-9c768e90-2df1-417e-ae9b-bc02d51ffcaa service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:37.263085 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ea40961b-ca96-4ee9-a14a-96af83ea3138 req-9c768e90-2df1-417e-ae9b-bc02d51ffcaa service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:37.263776 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ea40961b-ca96-4ee9-a14a-96af83ea3138 req-9c768e90-2df1-417e-ae9b-bc02d51ffcaa service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:37.274846 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-ea40961b-ca96-4ee9-a14a-96af83ea3138 req-9c768e90-2df1-417e-ae9b-bc02d51ffcaa service nova] Creating event network-changed:206a6ecc-a9ba-4d78-b340-8f29b89a766a for instance 97c6c085-c660-42cf-90ce-069f9ecfc17d on hv-cinder-84052 Aug 24 17:56:37.280009 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-ea40961b-ca96-4ee9-a14a-96af83ea3138 req-9c768e90-2df1-417e-ae9b-bc02d51ffcaa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031519 Aug 24 17:56:37.280618 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 452/876] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:37.400082 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-bc1faa69-08aa-4ea4-9446-98a9b858385d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:37.407795 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-bc1faa69-08aa-4ea4-9446-98a9b858385d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1266 microversion: 2.1 time: 0.274437 Aug 24 17:56:37.408356 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 425/877] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:37 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:38.430042 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5e9ef462-82a4-4415-83e8-752d97d07d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:38.430734 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5e9ef462-82a4-4415-83e8-752d97d07d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:38.436707 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5e9ef462-82a4-4415-83e8-752d97d07d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:38.437182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5e9ef462-82a4-4415-83e8-752d97d07d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:38.437615 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5e9ef462-82a4-4415-83e8-752d97d07d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:38.438293 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5e9ef462-82a4-4415-83e8-752d97d07d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:38.438740 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5e9ef462-82a4-4415-83e8-752d97d07d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:38.439157 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5e9ef462-82a4-4415-83e8-752d97d07d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:38.568080 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5e9ef462-82a4-4415-83e8-752d97d07d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:38.576481 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5e9ef462-82a4-4415-83e8-752d97d07d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1266 microversion: 2.1 time: 0.151027 Aug 24 17:56:38.577037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 453/878] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:38 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:39.596256 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a6a7b1d2-555b-4d08-b0f0-2dd27eb4d394 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:39.596885 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a6a7b1d2-555b-4d08-b0f0-2dd27eb4d394 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:39.603197 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a6a7b1d2-555b-4d08-b0f0-2dd27eb4d394 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:39.603707 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a6a7b1d2-555b-4d08-b0f0-2dd27eb4d394 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:39.604135 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a6a7b1d2-555b-4d08-b0f0-2dd27eb4d394 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:39.604815 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a6a7b1d2-555b-4d08-b0f0-2dd27eb4d394 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:39.607537 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a6a7b1d2-555b-4d08-b0f0-2dd27eb4d394 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:39.608030 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a6a7b1d2-555b-4d08-b0f0-2dd27eb4d394 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:39.735577 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-a6a7b1d2-555b-4d08-b0f0-2dd27eb4d394 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:39.743130 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a6a7b1d2-555b-4d08-b0f0-2dd27eb4d394 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1266 microversion: 2.1 time: 0.150872 Aug 24 17:56:39.743725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 426/879] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:39 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:40.765018 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-bae98dd4-96ff-4f69-a282-83f9e0fac254 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:40.765642 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-bae98dd4-96ff-4f69-a282-83f9e0fac254 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:40.772114 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bae98dd4-96ff-4f69-a282-83f9e0fac254 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:40.772542 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bae98dd4-96ff-4f69-a282-83f9e0fac254 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:40.772980 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bae98dd4-96ff-4f69-a282-83f9e0fac254 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:40.773674 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bae98dd4-96ff-4f69-a282-83f9e0fac254 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:40.774132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bae98dd4-96ff-4f69-a282-83f9e0fac254 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:40.774560 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-bae98dd4-96ff-4f69-a282-83f9e0fac254 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:40.906027 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-bae98dd4-96ff-4f69-a282-83f9e0fac254 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:40.913646 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-bae98dd4-96ff-4f69-a282-83f9e0fac254 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1266 microversion: 2.1 time: 0.153219 Aug 24 17:56:40.914206 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 454/880] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:40 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:41.934905 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2a903e0e-67bc-4797-a1c6-9ee4491a4e4f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:41.935451 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2a903e0e-67bc-4797-a1c6-9ee4491a4e4f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:41.941803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a903e0e-67bc-4797-a1c6-9ee4491a4e4f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:41.942283 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a903e0e-67bc-4797-a1c6-9ee4491a4e4f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:41.942713 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a903e0e-67bc-4797-a1c6-9ee4491a4e4f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:41.943401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a903e0e-67bc-4797-a1c6-9ee4491a4e4f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:41.943880 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a903e0e-67bc-4797-a1c6-9ee4491a4e4f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:41.944301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2a903e0e-67bc-4797-a1c6-9ee4491a4e4f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:42.080015 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-2a903e0e-67bc-4797-a1c6-9ee4491a4e4f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:42.088130 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2a903e0e-67bc-4797-a1c6-9ee4491a4e4f tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1266 microversion: 2.1 time: 0.157846 Aug 24 17:56:42.088702 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 427/881] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:41 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:43.108456 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-545a8556-209f-41d1-aa28-9fffaf817208 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:43.109038 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-545a8556-209f-41d1-aa28-9fffaf817208 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:43.115377 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-545a8556-209f-41d1-aa28-9fffaf817208 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:43.115895 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-545a8556-209f-41d1-aa28-9fffaf817208 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:43.116329 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-545a8556-209f-41d1-aa28-9fffaf817208 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:43.117021 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-545a8556-209f-41d1-aa28-9fffaf817208 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:43.117471 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-545a8556-209f-41d1-aa28-9fffaf817208 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:43.117896 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-545a8556-209f-41d1-aa28-9fffaf817208 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:43.247622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-545a8556-209f-41d1-aa28-9fffaf817208 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:43.255203 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-545a8556-209f-41d1-aa28-9fffaf817208 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1266 microversion: 2.1 time: 0.150772 Aug 24 17:56:43.255809 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 455/882] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:43 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:44.275908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c240e092-b1eb-4b94-bdb0-fbf057b28d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:44.276516 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c240e092-b1eb-4b94-bdb0-fbf057b28d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:44.283602 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c240e092-b1eb-4b94-bdb0-fbf057b28d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:44.284025 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c240e092-b1eb-4b94-bdb0-fbf057b28d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:44.284453 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c240e092-b1eb-4b94-bdb0-fbf057b28d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:44.285130 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c240e092-b1eb-4b94-bdb0-fbf057b28d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:44.285600 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c240e092-b1eb-4b94-bdb0-fbf057b28d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:44.286016 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c240e092-b1eb-4b94-bdb0-fbf057b28d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:44.416761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c240e092-b1eb-4b94-bdb0-fbf057b28d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:44.424563 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c240e092-b1eb-4b94-bdb0-fbf057b28d5b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1266 microversion: 2.1 time: 0.152509 Aug 24 17:56:44.425116 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 428/883] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:44 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:45.445438 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4d64dda7-492e-4f96-b408-8a0fb4f16f94 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:45.446062 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4d64dda7-492e-4f96-b408-8a0fb4f16f94 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:45.448721 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:45.449466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=6 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:45.454956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d64dda7-492e-4f96-b408-8a0fb4f16f94 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:45.455444 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d64dda7-492e-4f96-b408-8a0fb4f16f94 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:45.455912 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d64dda7-492e-4f96-b408-8a0fb4f16f94 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:45.456602 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d64dda7-492e-4f96-b408-8a0fb4f16f94 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:45.457064 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d64dda7-492e-4f96-b408-8a0fb4f16f94 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:45.457492 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4d64dda7-492e-4f96-b408-8a0fb4f16f94 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:45.588112 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4d64dda7-492e-4f96-b408-8a0fb4f16f94 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:45.596331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4d64dda7-492e-4f96-b408-8a0fb4f16f94 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1266 microversion: 2.1 time: 0.154750 Aug 24 17:56:45.596887 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 456/884] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:45 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:46.617635 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9dcb4231-3840-4e45-8516-5394906d8240 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:46.618265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9dcb4231-3840-4e45-8516-5394906d8240 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:46.620202 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:56:46.626054 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9dcb4231-3840-4e45-8516-5394906d8240 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:46.626602 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9dcb4231-3840-4e45-8516-5394906d8240 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:46.627033 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9dcb4231-3840-4e45-8516-5394906d8240 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:46.627767 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9dcb4231-3840-4e45-8516-5394906d8240 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:46.628226 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9dcb4231-3840-4e45-8516-5394906d8240 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:46.628647 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9dcb4231-3840-4e45-8516-5394906d8240 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:46.759122 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9dcb4231-3840-4e45-8516-5394906d8240 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:46.767734 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9dcb4231-3840-4e45-8516-5394906d8240 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1266 microversion: 2.1 time: 0.154021 Aug 24 17:56:46.768302 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 429/885] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:46 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:47.788491 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1955d31a-a253-4e38-b406-060098115dd2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:47.789027 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1955d31a-a253-4e38-b406-060098115dd2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:47.795407 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1955d31a-a253-4e38-b406-060098115dd2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:47.795918 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1955d31a-a253-4e38-b406-060098115dd2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:47.796351 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1955d31a-a253-4e38-b406-060098115dd2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:47.797040 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1955d31a-a253-4e38-b406-060098115dd2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:47.797495 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1955d31a-a253-4e38-b406-060098115dd2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:47.797918 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1955d31a-a253-4e38-b406-060098115dd2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:47.927092 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1955d31a-a253-4e38-b406-060098115dd2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:47.935395 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1955d31a-a253-4e38-b406-060098115dd2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1266 microversion: 2.1 time: 0.150844 Aug 24 17:56:47.936229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 457/886] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:47 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:48.077082 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-c67797d7-878d-4f4f-84a5-4f36a6e40410 req-112b7af6-aa19-482d-bfc4-8ca8c62cff52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c6c085-c660-42cf-90ce-069f9ecfc17d", "name": "network-vif-plugged", "status": "completed", "tag": "206a6ecc-a9ba-4d78-b340-8f29b89a766a"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:48.087971 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-c67797d7-878d-4f4f-84a5-4f36a6e40410 req-112b7af6-aa19-482d-bfc4-8ca8c62cff52 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:48.088444 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-c67797d7-878d-4f4f-84a5-4f36a6e40410 req-112b7af6-aa19-482d-bfc4-8ca8c62cff52 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:48.088863 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-c67797d7-878d-4f4f-84a5-4f36a6e40410 req-112b7af6-aa19-482d-bfc4-8ca8c62cff52 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:48.099772 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-c67797d7-878d-4f4f-84a5-4f36a6e40410 req-112b7af6-aa19-482d-bfc4-8ca8c62cff52 service nova] Creating event network-vif-plugged:206a6ecc-a9ba-4d78-b340-8f29b89a766a for instance 97c6c085-c660-42cf-90ce-069f9ecfc17d on hv-cinder-84052 Aug 24 17:56:48.104664 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-c67797d7-878d-4f4f-84a5-4f36a6e40410 req-112b7af6-aa19-482d-bfc4-8ca8c62cff52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031834 Aug 24 17:56:48.105769 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 430/887] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:56:48.561091 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-55d9ca08-f4f7-4e50-ab6d-a4e26623edaf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:48.561582 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-55d9ca08-f4f7-4e50-ab6d-a4e26623edaf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:48.567538 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-55d9ca08-f4f7-4e50-ab6d-a4e26623edaf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:48.568025 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-55d9ca08-f4f7-4e50-ab6d-a4e26623edaf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:48.568459 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-55d9ca08-f4f7-4e50-ab6d-a4e26623edaf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:48.569143 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-55d9ca08-f4f7-4e50-ab6d-a4e26623edaf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:48.569607 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-55d9ca08-f4f7-4e50-ab6d-a4e26623edaf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:48.570030 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-55d9ca08-f4f7-4e50-ab6d-a4e26623edaf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:48.593340 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-55d9ca08-f4f7-4e50-ab6d-a4e26623edaf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/ips" status: 200 len: 147 microversion: 2.1 time: 0.036795 Aug 24 17:56:48.593826 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 458/888] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 17:56:48 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:48.956917 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9587018a-8a5e-4287-95f2-73d0bdb370a3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:48.957558 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9587018a-8a5e-4287-95f2-73d0bdb370a3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:48.963747 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9587018a-8a5e-4287-95f2-73d0bdb370a3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:48.964239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9587018a-8a5e-4287-95f2-73d0bdb370a3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:48.964678 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9587018a-8a5e-4287-95f2-73d0bdb370a3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:48.965369 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9587018a-8a5e-4287-95f2-73d0bdb370a3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:48.965829 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9587018a-8a5e-4287-95f2-73d0bdb370a3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:48.966257 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9587018a-8a5e-4287-95f2-73d0bdb370a3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:49.096136 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9587018a-8a5e-4287-95f2-73d0bdb370a3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:49.103792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9587018a-8a5e-4287-95f2-73d0bdb370a3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1266 microversion: 2.1 time: 0.151226 Aug 24 17:56:49.104362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 431/889] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:48 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:50.125534 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9829836c-2779-41f6-a16e-b21554f6df41 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:50.126152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9829836c-2779-41f6-a16e-b21554f6df41 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:50.132500 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9829836c-2779-41f6-a16e-b21554f6df41 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:50.132981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9829836c-2779-41f6-a16e-b21554f6df41 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:50.133411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9829836c-2779-41f6-a16e-b21554f6df41 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:50.134118 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9829836c-2779-41f6-a16e-b21554f6df41 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:50.134549 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9829836c-2779-41f6-a16e-b21554f6df41 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:50.134971 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9829836c-2779-41f6-a16e-b21554f6df41 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:50.267036 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9829836c-2779-41f6-a16e-b21554f6df41 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:50.275119 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9829836c-2779-41f6-a16e-b21554f6df41 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1452 microversion: 2.1 time: 0.153476 Aug 24 17:56:50.275726 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 459/890] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:50 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:50.300149 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e1bf9936-23af-4420-bc4e-cf432b6bc335 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:50.300713 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e1bf9936-23af-4420-bc4e-cf432b6bc335 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:50.307131 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e1bf9936-23af-4420-bc4e-cf432b6bc335 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:50.307705 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e1bf9936-23af-4420-bc4e-cf432b6bc335 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:50.308109 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e1bf9936-23af-4420-bc4e-cf432b6bc335 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:50.309118 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e1bf9936-23af-4420-bc4e-cf432b6bc335 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:50.309584 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e1bf9936-23af-4420-bc4e-cf432b6bc335 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:50.310182 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e1bf9936-23af-4420-bc4e-cf432b6bc335 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:50.444843 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e1bf9936-23af-4420-bc4e-cf432b6bc335 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:50.453671 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e1bf9936-23af-4420-bc4e-cf432b6bc335 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1452 microversion: 2.1 time: 0.158026 Aug 24 17:56:50.454224 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 432/891] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:50 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:51.133006 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8b56f6c1-eb84-48a7-aed2-4344f44b0e3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ddfee43-2755-47ce-98e2-216b7580b3ce"}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:51.135444 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8b56f6c1-eb84-48a7-aed2-4344f44b0e3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:51.142142 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b56f6c1-eb84-48a7-aed2-4344f44b0e3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:51.142635 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b56f6c1-eb84-48a7-aed2-4344f44b0e3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:51.143072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b56f6c1-eb84-48a7-aed2-4344f44b0e3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:51.144018 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b56f6c1-eb84-48a7-aed2-4344f44b0e3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:51.144480 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b56f6c1-eb84-48a7-aed2-4344f44b0e3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:51.144914 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8b56f6c1-eb84-48a7-aed2-4344f44b0e3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:51.389366 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8b56f6c1-eb84-48a7-aed2-4344f44b0e3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "POST /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260128 Aug 24 17:56:51.390034 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 460/892] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:56:51 2022] POST /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:52.216091 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-74f8da6f-537d-4051-84f1-172907f9e426 req-6b2c5ed2-560f-48a8-bbfd-a7670449c3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c6c085-c660-42cf-90ce-069f9ecfc17d", "tag": "206a6ecc-a9ba-4d78-b340-8f29b89a766a"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:52.225751 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-74f8da6f-537d-4051-84f1-172907f9e426 req-6b2c5ed2-560f-48a8-bbfd-a7670449c3b4 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:52.226235 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-74f8da6f-537d-4051-84f1-172907f9e426 req-6b2c5ed2-560f-48a8-bbfd-a7670449c3b4 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:52.226667 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-74f8da6f-537d-4051-84f1-172907f9e426 req-6b2c5ed2-560f-48a8-bbfd-a7670449c3b4 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:52.237729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-74f8da6f-537d-4051-84f1-172907f9e426 req-6b2c5ed2-560f-48a8-bbfd-a7670449c3b4 service nova] Creating event network-changed:206a6ecc-a9ba-4d78-b340-8f29b89a766a for instance 97c6c085-c660-42cf-90ce-069f9ecfc17d on hv-cinder-84052 Aug 24 17:56:52.242772 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-74f8da6f-537d-4051-84f1-172907f9e426 req-6b2c5ed2-560f-48a8-bbfd-a7670449c3b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030369 Aug 24 17:56:52.243424 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 433/893] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:53.262316 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-81a654bf-8261-460c-ae7f-4f809f6432e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:53.262889 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-81a654bf-8261-460c-ae7f-4f809f6432e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:53.269024 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-81a654bf-8261-460c-ae7f-4f809f6432e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:53.269603 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-81a654bf-8261-460c-ae7f-4f809f6432e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:53.269960 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-81a654bf-8261-460c-ae7f-4f809f6432e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:53.270654 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-81a654bf-8261-460c-ae7f-4f809f6432e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:53.271106 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-81a654bf-8261-460c-ae7f-4f809f6432e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:53.271676 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-81a654bf-8261-460c-ae7f-4f809f6432e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:53.295602 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-81a654bf-8261-460c-ae7f-4f809f6432e2 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/ips" status: 200 len: 149 microversion: 2.1 time: 0.037812 Aug 24 17:56:53.296074 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 461/894] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 17:56:53 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:54.626883 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b2f991c1-d6aa-4b1d-bef7-473ef0027ed9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18a0e675-a2e7-4bb3-ab73-35940f5ab54e"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:54.629303 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b2f991c1-d6aa-4b1d-bef7-473ef0027ed9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:54.635419 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2f991c1-d6aa-4b1d-bef7-473ef0027ed9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:54.636457 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2f991c1-d6aa-4b1d-bef7-473ef0027ed9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:54.636897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2f991c1-d6aa-4b1d-bef7-473ef0027ed9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:54.637595 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2f991c1-d6aa-4b1d-bef7-473ef0027ed9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:54.638056 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2f991c1-d6aa-4b1d-bef7-473ef0027ed9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:54.638485 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b2f991c1-d6aa-4b1d-bef7-473ef0027ed9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:54.867736 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b2f991c1-d6aa-4b1d-bef7-473ef0027ed9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245379 Aug 24 17:56:54.868342 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 434/895] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:56:54 2022] POST /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:56:57.869640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ec67d778-28d3-4714-8f4c-414ec61b3ec2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:57.877917 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ec67d778-28d3-4714-8f4c-414ec61b3ec2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:57.878409 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ec67d778-28d3-4714-8f4c-414ec61b3ec2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:57.878849 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ec67d778-28d3-4714-8f4c-414ec61b3ec2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:57.940281 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ec67d778-28d3-4714-8f4c-414ec61b3ec2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Going to try to stop instance {{(pid=126994) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 17:56:57.985087 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ec67d778-28d3-4714-8f4c-414ec61b3ec2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "POST /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/action" status: 202 len: 0 microversion: 2.1 time: 0.119261 Aug 24 17:56:57.985623 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 462/896] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:56:57 2022] POST /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:56:57.996070 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6a004f8b-fbf8-4560-aff0-e73dd04d29ad tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:57.996782 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6a004f8b-fbf8-4560-aff0-e73dd04d29ad tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:58.003374 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6a004f8b-fbf8-4560-aff0-e73dd04d29ad tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:58.003895 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6a004f8b-fbf8-4560-aff0-e73dd04d29ad tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:58.004336 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6a004f8b-fbf8-4560-aff0-e73dd04d29ad tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:58.005049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6a004f8b-fbf8-4560-aff0-e73dd04d29ad tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:58.005518 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6a004f8b-fbf8-4560-aff0-e73dd04d29ad tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:58.005969 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6a004f8b-fbf8-4560-aff0-e73dd04d29ad tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:58.151259 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6a004f8b-fbf8-4560-aff0-e73dd04d29ad tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:58.159447 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6a004f8b-fbf8-4560-aff0-e73dd04d29ad tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.168954 Aug 24 17:56:58.160022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 435/897] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:57 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:59.180062 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5ef613ad-9d1c-432a-a552-e66410d6a027 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:59.180753 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5ef613ad-9d1c-432a-a552-e66410d6a027 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:59.187192 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5ef613ad-9d1c-432a-a552-e66410d6a027 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:59.187706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5ef613ad-9d1c-432a-a552-e66410d6a027 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:59.188143 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5ef613ad-9d1c-432a-a552-e66410d6a027 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:59.188827 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5ef613ad-9d1c-432a-a552-e66410d6a027 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:59.189279 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5ef613ad-9d1c-432a-a552-e66410d6a027 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:59.189700 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5ef613ad-9d1c-432a-a552-e66410d6a027 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:59.227132 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-36827130-b442-4b0d-8ae9-cc3c7844d2ac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18a0e675-a2e7-4bb3-ab73-35940f5ab54e"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:56:59.229590 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-36827130-b442-4b0d-8ae9-cc3c7844d2ac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:59.236151 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-36827130-b442-4b0d-8ae9-cc3c7844d2ac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:59.236634 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-36827130-b442-4b0d-8ae9-cc3c7844d2ac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:59.237073 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-36827130-b442-4b0d-8ae9-cc3c7844d2ac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:59.237768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-36827130-b442-4b0d-8ae9-cc3c7844d2ac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:59.238226 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-36827130-b442-4b0d-8ae9-cc3c7844d2ac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:59.238648 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-36827130-b442-4b0d-8ae9-cc3c7844d2ac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:59.318483 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-36827130-b442-4b0d-8ae9-cc3c7844d2ac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Invalid volume: volume 18a0e675-a2e7-4bb3-ab73-35940f5ab54e is already attached to instances: 887986a8-3a8d-4a88-8aa4-a97a16e391ac Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-36827130-b442-4b0d-8ae9-cc3c7844d2ac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: POST /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-volume_attachments HTTP/1.1 Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 74 Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:56:59.320239 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:56:59.322013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:56:59.322013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:56:59.322013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:56:59.322013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:56:59.322013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:56:59.322013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:56:59.322013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:56:59.322013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:56:59.322013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:56:59.322013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Aug 24 17:56:59.322013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {"volumeAttachment": {"volumeId": "18a0e675-a2e7-4bb3-ab73-35940f5ab54e"}} Aug 24 17:56:59.322013 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Invalid volume: volume 18a0e675-a2e7-4bb3-ab73-35940f5ab54e is already attached to instances: 887986a8-3a8d-4a88-8aa4-a97a16e391ac Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'server_id': '887986a8-3a8d-4a88-8aa4-a97a16e391ac', 'body': {'volumeAttachment': {'volumeId': '18a0e675-a2e7-4bb3-ab73-35940f5ab54e'}}} Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5124, in attach_volume Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4964, in _check_volume_already_attached Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 18a0e675-a2e7-4bb3-ab73-35940f5ab54e is already attached to instances: 887986a8-3a8d-4a88-8aa4-a97a16e391ac Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:56:59.323242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 18a0e675-a2e7-4bb3-ab73-35940f5ab54e is already attached to instances: 887986a8-3a8d-4a88-8aa4-a97a16e391ac Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:56:59.325265 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:56:59.326769 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:56:59.326769 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:56:59.326769 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:56:59.326769 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 18a0e675-a2e7-4bb3-ab73-35940f5ab54e is already attached to instances: 887986a8-3a8d-4a88-8aa4-a97a16e391ac Aug 24 17:56:59.326769 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:56:59.327180 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5ef613ad-9d1c-432a-a552-e66410d6a027 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:56:59.327298 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-36827130-b442-4b0d-8ae9-cc3c7844d2ac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 400 to user: Invalid volume: volume 18a0e675-a2e7-4bb3-ab73-35940f5ab54e is already attached to instances: 887986a8-3a8d-4a88-8aa4-a97a16e391ac {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:56:59.327298 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-36827130-b442-4b0d-8ae9-cc3c7844d2ac tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098587 Aug 24 17:56:59.327298 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 436/898] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:56:59 2022] POST /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 17:56:59.334120 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5ef613ad-9d1c-432a-a552-e66410d6a027 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.158213 Aug 24 17:56:59.334697 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 463/899] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:56:59 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:56:59.385470 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5e9b98ec-b2ab-4bae-b594-961a9cd17048 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:59.385892 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5e9b98ec-b2ab-4bae-b594-961a9cd17048 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:59.393243 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5e9b98ec-b2ab-4bae-b594-961a9cd17048 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:59.393735 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5e9b98ec-b2ab-4bae-b594-961a9cd17048 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:59.394171 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5e9b98ec-b2ab-4bae-b594-961a9cd17048 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:59.394867 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5e9b98ec-b2ab-4bae-b594-961a9cd17048 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:59.395328 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5e9b98ec-b2ab-4bae-b594-961a9cd17048 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:59.395786 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5e9b98ec-b2ab-4bae-b594-961a9cd17048 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:59.474078 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-5e9b98ec-b2ab-4bae-b594-961a9cd17048 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lazy-loading 'services' on Instance uuid 887986a8-3a8d-4a88-8aa4-a97a16e391ac {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:56:59.543997 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5e9b98ec-b2ab-4bae-b594-961a9cd17048 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-volume_attachments/18a0e675-a2e7-4bb3-ab73-35940f5ab54e" status: 202 len: 0 microversion: 2.1 time: 0.162350 Aug 24 17:56:59.544761 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 437/900] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 17:56:59 2022] DELETE /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-volume_attachments/18a0e675-a2e7-4bb3-ab73-35940f5ab54e => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:56:59.553102 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b37651e9-df31-4e9b-a300-34b3d9464163 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:56:59.555418 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b37651e9-df31-4e9b-a300-34b3d9464163 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:56:59.561853 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b37651e9-df31-4e9b-a300-34b3d9464163 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:59.562356 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b37651e9-df31-4e9b-a300-34b3d9464163 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:59.562813 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b37651e9-df31-4e9b-a300-34b3d9464163 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:59.563534 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b37651e9-df31-4e9b-a300-34b3d9464163 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:56:59.563995 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b37651e9-df31-4e9b-a300-34b3d9464163 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:56:59.564512 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b37651e9-df31-4e9b-a300-34b3d9464163 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:56:59.595393 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b37651e9-df31-4e9b-a300-34b3d9464163 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046236 Aug 24 17:56:59.596071 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 464/901] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:56:59 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:57:00.356083 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8a36719c-96f7-46c9-b97d-e8424abd8ce4 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:00.356725 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8a36719c-96f7-46c9-b97d-e8424abd8ce4 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:00.363371 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a36719c-96f7-46c9-b97d-e8424abd8ce4 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:00.363907 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a36719c-96f7-46c9-b97d-e8424abd8ce4 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:00.364345 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a36719c-96f7-46c9-b97d-e8424abd8ce4 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:00.365040 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a36719c-96f7-46c9-b97d-e8424abd8ce4 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:00.365500 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a36719c-96f7-46c9-b97d-e8424abd8ce4 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:00.365926 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8a36719c-96f7-46c9-b97d-e8424abd8ce4 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:00.495163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8a36719c-96f7-46c9-b97d-e8424abd8ce4 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:00.503257 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8a36719c-96f7-46c9-b97d-e8424abd8ce4 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.152277 Aug 24 17:57:00.503851 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 438/902] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:00 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:00.608205 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c9223600-e7a8-465a-bb28-4e3b152fbae0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:00.619960 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c9223600-e7a8-465a-bb28-4e3b152fbae0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:00.623269 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c9223600-e7a8-465a-bb28-4e3b152fbae0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:00.623810 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c9223600-e7a8-465a-bb28-4e3b152fbae0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:00.624246 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c9223600-e7a8-465a-bb28-4e3b152fbae0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:00.624926 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c9223600-e7a8-465a-bb28-4e3b152fbae0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:00.625376 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c9223600-e7a8-465a-bb28-4e3b152fbae0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:00.625794 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c9223600-e7a8-465a-bb28-4e3b152fbae0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:00.655737 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c9223600-e7a8-465a-bb28-4e3b152fbae0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051805 Aug 24 17:57:00.656287 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 465/903] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:57:00 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:57:00.716823 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-969b6bb9-2c4b-48e5-af13-67b6f85beaf5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:00.717330 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-969b6bb9-2c4b-48e5-af13-67b6f85beaf5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:00.723227 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-969b6bb9-2c4b-48e5-af13-67b6f85beaf5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:00.723748 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-969b6bb9-2c4b-48e5-af13-67b6f85beaf5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:00.724190 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-969b6bb9-2c4b-48e5-af13-67b6f85beaf5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:00.724885 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-969b6bb9-2c4b-48e5-af13-67b6f85beaf5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:00.725369 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-969b6bb9-2c4b-48e5-af13-67b6f85beaf5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:00.725791 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-969b6bb9-2c4b-48e5-af13-67b6f85beaf5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:00.750057 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-969b6bb9-2c4b-48e5-af13-67b6f85beaf5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:57:00.783963 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:00.825792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-969b6bb9-2c4b-48e5-af13-67b6f85beaf5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 204 len: 0 microversion: 2.1 time: 0.113167 Aug 24 17:57:00.826365 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 439/904] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:57:00 2022] DELETE /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:57:00.834714 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3ba87570-11ae-4a92-b109-19782a52e025 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:00.835337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3ba87570-11ae-4a92-b109-19782a52e025 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:00.841866 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ba87570-11ae-4a92-b109-19782a52e025 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:00.842354 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ba87570-11ae-4a92-b109-19782a52e025 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:00.842793 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ba87570-11ae-4a92-b109-19782a52e025 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:00.843506 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ba87570-11ae-4a92-b109-19782a52e025 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:00.843973 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ba87570-11ae-4a92-b109-19782a52e025 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:00.844401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3ba87570-11ae-4a92-b109-19782a52e025 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:00.848429 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:00.978217 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3ba87570-11ae-4a92-b109-19782a52e025 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:00.985887 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3ba87570-11ae-4a92-b109-19782a52e025 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1681 microversion: 2.1 time: 0.155000 Aug 24 17:57:00.986446 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 466/905] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:00 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:01.524774 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4de81c96-bec4-4904-a2fb-04b71742e06a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:01.525544 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4de81c96-bec4-4904-a2fb-04b71742e06a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:01.532088 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4de81c96-bec4-4904-a2fb-04b71742e06a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:01.532579 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4de81c96-bec4-4904-a2fb-04b71742e06a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:01.533017 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4de81c96-bec4-4904-a2fb-04b71742e06a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:01.533715 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4de81c96-bec4-4904-a2fb-04b71742e06a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:01.534168 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4de81c96-bec4-4904-a2fb-04b71742e06a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:01.534590 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4de81c96-bec4-4904-a2fb-04b71742e06a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:01.668608 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4de81c96-bec4-4904-a2fb-04b71742e06a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:01.676824 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4de81c96-bec4-4904-a2fb-04b71742e06a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.156302 Aug 24 17:57:01.677395 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 440/906] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:01 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:02.007272 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7e2c7480-abad-4108-99c1-3f709a87a0e4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:02.007919 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7e2c7480-abad-4108-99c1-3f709a87a0e4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:02.014389 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e2c7480-abad-4108-99c1-3f709a87a0e4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:02.014872 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e2c7480-abad-4108-99c1-3f709a87a0e4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:02.015310 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e2c7480-abad-4108-99c1-3f709a87a0e4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:02.016031 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e2c7480-abad-4108-99c1-3f709a87a0e4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:02.016491 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e2c7480-abad-4108-99c1-3f709a87a0e4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:02.016916 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e2c7480-abad-4108-99c1-3f709a87a0e4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:02.155465 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7e2c7480-abad-4108-99c1-3f709a87a0e4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:02.163308 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7e2c7480-abad-4108-99c1-3f709a87a0e4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1681 microversion: 2.1 time: 0.159933 Aug 24 17:57:02.163902 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 467/907] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:02 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:02.698453 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-109d4899-58c6-4654-8d65-888f6aa0dc62 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:02.699178 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-109d4899-58c6-4654-8d65-888f6aa0dc62 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:02.705910 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-109d4899-58c6-4654-8d65-888f6aa0dc62 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:02.706403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-109d4899-58c6-4654-8d65-888f6aa0dc62 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:02.706842 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-109d4899-58c6-4654-8d65-888f6aa0dc62 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:02.707574 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-109d4899-58c6-4654-8d65-888f6aa0dc62 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:02.708037 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-109d4899-58c6-4654-8d65-888f6aa0dc62 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:02.708494 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-109d4899-58c6-4654-8d65-888f6aa0dc62 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:02.952298 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-109d4899-58c6-4654-8d65-888f6aa0dc62 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:02.960586 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-109d4899-58c6-4654-8d65-888f6aa0dc62 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.266304 Aug 24 17:57:02.961166 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 441/908] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:02 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:03.184663 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-aeeb556d-4871-48bd-b683-e8f31d9419b6 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:03.185404 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-aeeb556d-4871-48bd-b683-e8f31d9419b6 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:03.192006 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aeeb556d-4871-48bd-b683-e8f31d9419b6 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:03.192509 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aeeb556d-4871-48bd-b683-e8f31d9419b6 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:03.192927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aeeb556d-4871-48bd-b683-e8f31d9419b6 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:03.193624 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aeeb556d-4871-48bd-b683-e8f31d9419b6 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:03.194079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aeeb556d-4871-48bd-b683-e8f31d9419b6 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:03.194498 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-aeeb556d-4871-48bd-b683-e8f31d9419b6 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:03.256726 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-aeeb556d-4871-48bd-b683-e8f31d9419b6 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:03.266900 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-aeeb556d-4871-48bd-b683-e8f31d9419b6 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 200 len: 1613 microversion: 2.1 time: 0.086190 Aug 24 17:57:03.267557 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 468/909] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:03 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 1613 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:03.402574 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-d33f8e01-b268-47b3-b076-62571d0cd4cf req-e777589a-4ba6-4e06-a7d2-550a2a00efe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "887986a8-3a8d-4a88-8aa4-a97a16e391ac", "name": "network-vif-deleted", "tag": "56f3b43c-0345-4a96-8783-3b7d326dd2cf"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:03.418825 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-d33f8e01-b268-47b3-b076-62571d0cd4cf req-e777589a-4ba6-4e06-a7d2-550a2a00efe1 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:03.419450 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-d33f8e01-b268-47b3-b076-62571d0cd4cf req-e777589a-4ba6-4e06-a7d2-550a2a00efe1 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:03.420058 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-d33f8e01-b268-47b3-b076-62571d0cd4cf req-e777589a-4ba6-4e06-a7d2-550a2a00efe1 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:03.432022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-d33f8e01-b268-47b3-b076-62571d0cd4cf req-e777589a-4ba6-4e06-a7d2-550a2a00efe1 service nova] Creating event network-vif-deleted:56f3b43c-0345-4a96-8783-3b7d326dd2cf for instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac on hv-cinder-84052 Aug 24 17:57:03.437378 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-d33f8e01-b268-47b3-b076-62571d0cd4cf req-e777589a-4ba6-4e06-a7d2-550a2a00efe1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038926 Aug 24 17:57:03.438598 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 442/910] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:57:03.982666 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3487f5b2-971b-4428-abcc-a57d72bf7e69 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:03.983285 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3487f5b2-971b-4428-abcc-a57d72bf7e69 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:03.989687 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3487f5b2-971b-4428-abcc-a57d72bf7e69 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:03.990179 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3487f5b2-971b-4428-abcc-a57d72bf7e69 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:03.990617 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3487f5b2-971b-4428-abcc-a57d72bf7e69 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:03.991314 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3487f5b2-971b-4428-abcc-a57d72bf7e69 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:03.991805 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3487f5b2-971b-4428-abcc-a57d72bf7e69 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:03.992229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3487f5b2-971b-4428-abcc-a57d72bf7e69 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:04.290394 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-71101d3d-9927-4fa1-90b2-7c7261a8333e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:04.293531 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-71101d3d-9927-4fa1-90b2-7c7261a8333e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:04.301100 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-71101d3d-9927-4fa1-90b2-7c7261a8333e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:04.302057 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-71101d3d-9927-4fa1-90b2-7c7261a8333e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:04.302971 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-71101d3d-9927-4fa1-90b2-7c7261a8333e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:04.304053 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-71101d3d-9927-4fa1-90b2-7c7261a8333e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:04.304679 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-71101d3d-9927-4fa1-90b2-7c7261a8333e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:04.305271 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-71101d3d-9927-4fa1-90b2-7c7261a8333e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:04.320228 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-71101d3d-9927-4fa1-90b2-7c7261a8333e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-71101d3d-9927-4fa1-90b2-7c7261a8333e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac HTTP/1.1 Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:57:04.321897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:57:04.324401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:57:04.324401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:57:04.324401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:57:04.324401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:57:04.324401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:57:04.324401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:57:04.324401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:57:04.324401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:57:04.324401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:57:04.324401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:57:04.324401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:57:04.324401 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '887986a8-3a8d-4a88-8aa4-a97a16e391ac'} Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:57:04.328765 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:57:04.331899 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:57:04.333418 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-71101d3d-9927-4fa1-90b2-7c7261a8333e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 404 to user: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:57:04.333418 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-71101d3d-9927-4fa1-90b2-7c7261a8333e tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 404 len: 111 microversion: 2.1 time: 0.038268 Aug 24 17:57:04.333418 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 443/911] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:04 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:57:04.335371 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-eabfb380-fb63-429b-b475-167fee28744b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '.version_select at 0x7f4b2a1295e0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:04.355095 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-eabfb380-fb63-429b-b475-167fee28744b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1089162182" status: 202 len: 0 microversion: 2.1 time: 0.025070 Aug 24 17:57:04.355996 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 444/912] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 24 17:57:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1089162182 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:57:04.381495 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-3487f5b2-971b-4428-abcc-a57d72bf7e69 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:04.390842 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3487f5b2-971b-4428-abcc-a57d72bf7e69 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.412191 Aug 24 17:57:04.391385 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 469/913] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:03 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:04.967177 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-47493033-24e0-40b2-aab6-acb04b325084 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: .version_select at 0x7f4b2a063e50>, body: {"keypair": {"name": "tempest-keypair-1280211702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuZEDT/xKgXbD2zlMlHekBSUU+6rKV4zxhgeo/5hyFe1FQIn/eeQ0Py0ONYTnBXGTggGsvtwX7Hz/+z47nZvhYnRqVrhW7BqnhYrbQ8FX1qUkpK4UZ+x3mQMUaWXmNXLg=="}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:04.972437 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:04.986151 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-47493033-24e0-40b2-aab6-acb04b325084 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for project 625652cfa47248faac8c1f7759c56a14. Resources: {'key_pairs'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:57:04.990162 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-47493033-24e0-40b2-aab6-acb04b325084 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for user d8b9d2b042c04927b9115085fcb4ba40 and project 625652cfa47248faac8c1f7759c56a14. Resources: {'key_pairs'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:57:05.012523 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-47493033-24e0-40b2-aab6-acb04b325084 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049448 Aug 24 17:57:05.013106 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 445/914] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 17:57:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:57:05.411280 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d9f8e5ed-3351-4ecf-909d-b2e3fd1c6683 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:05.412022 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d9f8e5ed-3351-4ecf-909d-b2e3fd1c6683 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:05.414406 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:05.420327 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d9f8e5ed-3351-4ecf-909d-b2e3fd1c6683 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:05.420812 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d9f8e5ed-3351-4ecf-909d-b2e3fd1c6683 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:05.421243 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d9f8e5ed-3351-4ecf-909d-b2e3fd1c6683 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:05.421962 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d9f8e5ed-3351-4ecf-909d-b2e3fd1c6683 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:05.422436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d9f8e5ed-3351-4ecf-909d-b2e3fd1c6683 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:05.422924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d9f8e5ed-3351-4ecf-909d-b2e3fd1c6683 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:05.640938 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-d9f8e5ed-3351-4ecf-909d-b2e3fd1c6683 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:05.649183 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d9f8e5ed-3351-4ecf-909d-b2e3fd1c6683 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.241696 Aug 24 17:57:05.649746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 470/915] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:05 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:06.352965 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1132033586", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87807a97-d368-4c81-a10c-4e62e5ebdb01"}], "security_groups": [{"name": "tempest-securitygroup--1167994114"}], "key_name": "tempest-keypair-1280211702", "user_data": "}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:06.456852 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] validate_networks() for [('87807a97-d368-4c81-a10c-4e62e5ebdb01', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:57:06.670965 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8400d683-e34e-4bdd-8b70-af340161183f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:06.671610 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8400d683-e34e-4bdd-8b70-af340161183f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:06.677926 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8400d683-e34e-4bdd-8b70-af340161183f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:06.678416 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8400d683-e34e-4bdd-8b70-af340161183f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:06.678855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8400d683-e34e-4bdd-8b70-af340161183f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:06.679572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8400d683-e34e-4bdd-8b70-af340161183f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:06.680032 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8400d683-e34e-4bdd-8b70-af340161183f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:06.680456 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8400d683-e34e-4bdd-8b70-af340161183f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:06.809256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8400d683-e34e-4bdd-8b70-af340161183f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:06.817409 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8400d683-e34e-4bdd-8b70-af340161183f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.150758 Aug 24 17:57:06.817984 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 471/916] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:06 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:57:06.821380 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:57:06.821798 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:57:06.822532 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:57:06.822935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:57:06.823343 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:57:06.832136 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:06.832615 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:06.833046 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:06.833763 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:06.834222 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:06.834634 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:06.850742 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for project 625652cfa47248faac8c1f7759c56a14. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:57:06.855154 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Getting quotas for user d8b9d2b042c04927b9115085fcb4ba40 and project 625652cfa47248faac8c1f7759c56a14. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:57:06.866021 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:57:06.868315 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:57:06.916345 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-3abff9cf-eae0-4fc4-826a-0f29770453f0 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568376 Aug 24 17:57:06.916952 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 446/917] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:57:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:57:06.927841 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f226561d-7a67-45d2-b8b4-d86cb491ca56 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:06.928991 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f226561d-7a67-45d2-b8b4-d86cb491ca56 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:06.996088 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f226561d-7a67-45d2-b8b4-d86cb491ca56 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:07.004017 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f226561d-7a67-45d2-b8b4-d86cb491ca56 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 200 len: 1242 microversion: 2.1 time: 0.079942 Aug 24 17:57:07.004727 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 472/918] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:06 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:07.838405 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5d0d9af3-73e2-461d-84a4-68efa027161a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:07.839504 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5d0d9af3-73e2-461d-84a4-68efa027161a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:07.846603 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d0d9af3-73e2-461d-84a4-68efa027161a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:07.847082 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d0d9af3-73e2-461d-84a4-68efa027161a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:07.847538 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d0d9af3-73e2-461d-84a4-68efa027161a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:07.848229 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d0d9af3-73e2-461d-84a4-68efa027161a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:07.848680 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d0d9af3-73e2-461d-84a4-68efa027161a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:07.849098 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d0d9af3-73e2-461d-84a4-68efa027161a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:08.026869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-418a3373-99ee-4d7f-9a84-89b7e748cc46 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:08.027665 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-418a3373-99ee-4d7f-9a84-89b7e748cc46 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:08.034212 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-418a3373-99ee-4d7f-9a84-89b7e748cc46 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:08.034703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-418a3373-99ee-4d7f-9a84-89b7e748cc46 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:08.035469 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-418a3373-99ee-4d7f-9a84-89b7e748cc46 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:08.036831 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-418a3373-99ee-4d7f-9a84-89b7e748cc46 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:08.036831 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-418a3373-99ee-4d7f-9a84-89b7e748cc46 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:08.037275 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-418a3373-99ee-4d7f-9a84-89b7e748cc46 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:08.071782 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-5d0d9af3-73e2-461d-84a4-68efa027161a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:08.080863 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5d0d9af3-73e2-461d-84a4-68efa027161a tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.246397 Aug 24 17:57:08.081501 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 447/919] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:07 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:08.108274 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-418a3373-99ee-4d7f-9a84-89b7e748cc46 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:08.116430 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-418a3373-99ee-4d7f-9a84-89b7e748cc46 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 200 len: 1300 microversion: 2.1 time: 0.094616 Aug 24 17:57:08.116994 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 473/920] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:08 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:09.102249 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8fb11a92-3ef3-4bd1-bb92-fa3e5fb53691 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:09.102873 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8fb11a92-3ef3-4bd1-bb92-fa3e5fb53691 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:09.109277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8fb11a92-3ef3-4bd1-bb92-fa3e5fb53691 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:09.109770 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8fb11a92-3ef3-4bd1-bb92-fa3e5fb53691 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:09.110208 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8fb11a92-3ef3-4bd1-bb92-fa3e5fb53691 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:09.110913 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8fb11a92-3ef3-4bd1-bb92-fa3e5fb53691 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:09.111375 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8fb11a92-3ef3-4bd1-bb92-fa3e5fb53691 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:09.111833 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8fb11a92-3ef3-4bd1-bb92-fa3e5fb53691 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:09.138868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-389fdcf6-6ba9-48ab-b139-9f36ea232074 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:09.140400 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-389fdcf6-6ba9-48ab-b139-9f36ea232074 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:09.147847 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-389fdcf6-6ba9-48ab-b139-9f36ea232074 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:09.148474 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-389fdcf6-6ba9-48ab-b139-9f36ea232074 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:09.149022 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-389fdcf6-6ba9-48ab-b139-9f36ea232074 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:09.149831 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-389fdcf6-6ba9-48ab-b139-9f36ea232074 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:09.150455 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-389fdcf6-6ba9-48ab-b139-9f36ea232074 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:09.151677 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-389fdcf6-6ba9-48ab-b139-9f36ea232074 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:09.356389 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-389fdcf6-6ba9-48ab-b139-9f36ea232074 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:09.359313 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8fb11a92-3ef3-4bd1-bb92-fa3e5fb53691 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:09.365494 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-389fdcf6-6ba9-48ab-b139-9f36ea232074 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 200 len: 1368 microversion: 2.1 time: 0.232648 Aug 24 17:57:09.368271 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8fb11a92-3ef3-4bd1-bb92-fa3e5fb53691 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.269853 Aug 24 17:57:09.369550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 448/921] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:09 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:09.380299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 474/922] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:09 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:09.497242 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-6ec97a61-8475-41a0-a65b-7088e4f797cf req-c39fac60-6dd7-4076-9073-b1ae5e745535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddeacc2-9845-45e4-a64e-4ee00365b530", "tag": "04238239-ff09-4a67-aedd-1b913bf3958d"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:09.506981 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-6ec97a61-8475-41a0-a65b-7088e4f797cf req-c39fac60-6dd7-4076-9073-b1ae5e745535 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:09.507676 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-6ec97a61-8475-41a0-a65b-7088e4f797cf req-c39fac60-6dd7-4076-9073-b1ae5e745535 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:09.508201 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-6ec97a61-8475-41a0-a65b-7088e4f797cf req-c39fac60-6dd7-4076-9073-b1ae5e745535 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:09.524395 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-6ec97a61-8475-41a0-a65b-7088e4f797cf req-c39fac60-6dd7-4076-9073-b1ae5e745535 service nova] Creating event network-changed:04238239-ff09-4a67-aedd-1b913bf3958d for instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 on hv-cinder-84052 Aug 24 17:57:09.529796 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-6ec97a61-8475-41a0-a65b-7088e4f797cf req-c39fac60-6dd7-4076-9073-b1ae5e745535 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041376 Aug 24 17:57:09.531025 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 449/923] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:57:10.386138 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-c8929f3d-b4da-4573-a644-85ad6e8aa22b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:10.386826 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-c8929f3d-b4da-4573-a644-85ad6e8aa22b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:10.390478 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-fd3c1a49-0497-42ac-a9a3-927d2481e72b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:10.391183 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-fd3c1a49-0497-42ac-a9a3-927d2481e72b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:10.393324 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c8929f3d-b4da-4573-a644-85ad6e8aa22b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:10.393814 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c8929f3d-b4da-4573-a644-85ad6e8aa22b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:10.394266 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c8929f3d-b4da-4573-a644-85ad6e8aa22b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:10.394955 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c8929f3d-b4da-4573-a644-85ad6e8aa22b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:10.395410 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c8929f3d-b4da-4573-a644-85ad6e8aa22b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:10.395874 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-c8929f3d-b4da-4573-a644-85ad6e8aa22b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:10.397953 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd3c1a49-0497-42ac-a9a3-927d2481e72b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:10.398443 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd3c1a49-0497-42ac-a9a3-927d2481e72b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:10.398879 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd3c1a49-0497-42ac-a9a3-927d2481e72b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:10.401000 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd3c1a49-0497-42ac-a9a3-927d2481e72b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:10.401000 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd3c1a49-0497-42ac-a9a3-927d2481e72b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:10.401000 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fd3c1a49-0497-42ac-a9a3-927d2481e72b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:10.530156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-c8929f3d-b4da-4573-a644-85ad6e8aa22b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:10.536359 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-fd3c1a49-0497-42ac-a9a3-927d2481e72b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:10.537888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-c8929f3d-b4da-4573-a644-85ad6e8aa22b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 200 len: 1368 microversion: 2.1 time: 0.155649 Aug 24 17:57:10.538434 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 475/924] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:10 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:10.545186 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-fd3c1a49-0497-42ac-a9a3-927d2481e72b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.158904 Aug 24 17:57:10.545745 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 450/925] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:10 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:57:11.559211 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-be979e02-35dc-4155-966c-18b851b083cf tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:11.559856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-be979e02-35dc-4155-966c-18b851b083cf tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:11.565860 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d1e34c8d-b12c-45a5-8b25-e18e1a26b0f0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:11.566431 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-be979e02-35dc-4155-966c-18b851b083cf tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:11.566571 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d1e34c8d-b12c-45a5-8b25-e18e1a26b0f0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:11.566931 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-be979e02-35dc-4155-966c-18b851b083cf tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:11.567371 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-be979e02-35dc-4155-966c-18b851b083cf tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:11.568102 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-be979e02-35dc-4155-966c-18b851b083cf tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:11.568565 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-be979e02-35dc-4155-966c-18b851b083cf tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:11.569006 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-be979e02-35dc-4155-966c-18b851b083cf tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:11.573053 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d1e34c8d-b12c-45a5-8b25-e18e1a26b0f0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:11.574105 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d1e34c8d-b12c-45a5-8b25-e18e1a26b0f0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:11.574541 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d1e34c8d-b12c-45a5-8b25-e18e1a26b0f0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:11.575232 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d1e34c8d-b12c-45a5-8b25-e18e1a26b0f0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:11.575707 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d1e34c8d-b12c-45a5-8b25-e18e1a26b0f0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:11.576126 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d1e34c8d-b12c-45a5-8b25-e18e1a26b0f0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:11.702320 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-be979e02-35dc-4155-966c-18b851b083cf tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:11.706629 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d1e34c8d-b12c-45a5-8b25-e18e1a26b0f0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:11.710121 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-be979e02-35dc-4155-966c-18b851b083cf tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 200 len: 1368 microversion: 2.1 time: 0.155353 Aug 24 17:57:11.710705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 476/926] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:11 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:11.714757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d1e34c8d-b12c-45a5-8b25-e18e1a26b0f0 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.152720 Aug 24 17:57:11.715306 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 451/927] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:11 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:57:12.733831 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9baac9fb-1ad2-4c62-aba5-7dee663d041f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:12.734404 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9baac9fb-1ad2-4c62-aba5-7dee663d041f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:12.736032 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e92760fa-afd6-4ccb-a9ed-06ccea5f49f2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:12.736856 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e92760fa-afd6-4ccb-a9ed-06ccea5f49f2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:12.740893 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9baac9fb-1ad2-4c62-aba5-7dee663d041f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:12.741382 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9baac9fb-1ad2-4c62-aba5-7dee663d041f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:12.741850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9baac9fb-1ad2-4c62-aba5-7dee663d041f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:12.742552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9baac9fb-1ad2-4c62-aba5-7dee663d041f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:12.743012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9baac9fb-1ad2-4c62-aba5-7dee663d041f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:12.743436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9baac9fb-1ad2-4c62-aba5-7dee663d041f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:12.743580 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e92760fa-afd6-4ccb-a9ed-06ccea5f49f2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:12.743995 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e92760fa-afd6-4ccb-a9ed-06ccea5f49f2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:12.744434 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e92760fa-afd6-4ccb-a9ed-06ccea5f49f2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:12.745127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e92760fa-afd6-4ccb-a9ed-06ccea5f49f2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:12.745581 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e92760fa-afd6-4ccb-a9ed-06ccea5f49f2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:12.746008 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e92760fa-afd6-4ccb-a9ed-06ccea5f49f2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:12.888686 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e92760fa-afd6-4ccb-a9ed-06ccea5f49f2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:12.897426 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e92760fa-afd6-4ccb-a9ed-06ccea5f49f2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.165363 Aug 24 17:57:12.898005 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 452/928] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:12 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:57:13.019258 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9baac9fb-1ad2-4c62-aba5-7dee663d041f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:13.026962 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9baac9fb-1ad2-4c62-aba5-7dee663d041f tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 200 len: 1368 microversion: 2.1 time: 0.297548 Aug 24 17:57:13.027542 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 477/929] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:12 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:57:13.918755 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d208f39a-f7d0-4bed-8bed-1adb69b5528e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:13.919353 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d208f39a-f7d0-4bed-8bed-1adb69b5528e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:13.925669 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d208f39a-f7d0-4bed-8bed-1adb69b5528e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:13.926147 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d208f39a-f7d0-4bed-8bed-1adb69b5528e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:13.926575 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d208f39a-f7d0-4bed-8bed-1adb69b5528e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:13.927254 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d208f39a-f7d0-4bed-8bed-1adb69b5528e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:13.927732 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d208f39a-f7d0-4bed-8bed-1adb69b5528e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:13.928151 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d208f39a-f7d0-4bed-8bed-1adb69b5528e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:14.048422 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-f6c9c46c-8cf4-4eb5-b706-8900bebb49bb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:14.049239 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-f6c9c46c-8cf4-4eb5-b706-8900bebb49bb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:14.056019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f6c9c46c-8cf4-4eb5-b706-8900bebb49bb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:14.056507 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f6c9c46c-8cf4-4eb5-b706-8900bebb49bb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:14.056940 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f6c9c46c-8cf4-4eb5-b706-8900bebb49bb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:14.057612 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d208f39a-f7d0-4bed-8bed-1adb69b5528e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:14.057757 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f6c9c46c-8cf4-4eb5-b706-8900bebb49bb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:14.058079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f6c9c46c-8cf4-4eb5-b706-8900bebb49bb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:14.058502 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-f6c9c46c-8cf4-4eb5-b706-8900bebb49bb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:14.067159 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d208f39a-f7d0-4bed-8bed-1adb69b5528e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.152850 Aug 24 17:57:14.067989 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 453/930] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:13 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:14.195234 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-f6c9c46c-8cf4-4eb5-b706-8900bebb49bb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:14.204466 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-f6c9c46c-8cf4-4eb5-b706-8900bebb49bb tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 200 len: 1368 microversion: 2.1 time: 0.159908 Aug 24 17:57:14.205030 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 478/931] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:14 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:57:14.212305 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-8a17593b-f620-4d14-a6ac-30b07a589a36 req-44a8f5fc-9d76-400d-a29a-bd0d1f2f082b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddeacc2-9845-45e4-a64e-4ee00365b530", "name": "network-vif-plugged", "status": "completed", "tag": "04238239-ff09-4a67-aedd-1b913bf3958d"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:14.222972 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-8a17593b-f620-4d14-a6ac-30b07a589a36 req-44a8f5fc-9d76-400d-a29a-bd0d1f2f082b service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:14.223542 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-8a17593b-f620-4d14-a6ac-30b07a589a36 req-44a8f5fc-9d76-400d-a29a-bd0d1f2f082b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:14.224007 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-8a17593b-f620-4d14-a6ac-30b07a589a36 req-44a8f5fc-9d76-400d-a29a-bd0d1f2f082b service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:14.236250 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-8a17593b-f620-4d14-a6ac-30b07a589a36 req-44a8f5fc-9d76-400d-a29a-bd0d1f2f082b service nova] Creating event network-vif-plugged:04238239-ff09-4a67-aedd-1b913bf3958d for instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 on hv-cinder-84052 Aug 24 17:57:14.241074 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-8a17593b-f620-4d14-a6ac-30b07a589a36 req-44a8f5fc-9d76-400d-a29a-bd0d1f2f082b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032386 Aug 24 17:57:14.241781 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 454/932] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:57:15.089769 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9289dda8-3dfb-4d71-9ba3-9f1f3f535c0e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:15.090654 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9289dda8-3dfb-4d71-9ba3-9f1f3f535c0e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:15.097567 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9289dda8-3dfb-4d71-9ba3-9f1f3f535c0e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:15.098117 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9289dda8-3dfb-4d71-9ba3-9f1f3f535c0e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:15.098666 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9289dda8-3dfb-4d71-9ba3-9f1f3f535c0e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:15.099559 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9289dda8-3dfb-4d71-9ba3-9f1f3f535c0e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:15.100020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9289dda8-3dfb-4d71-9ba3-9f1f3f535c0e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:15.100441 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9289dda8-3dfb-4d71-9ba3-9f1f3f535c0e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:15.226779 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4871d5f8-a4fd-4f8e-b350-87c1a222ea52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:15.227538 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9289dda8-3dfb-4d71-9ba3-9f1f3f535c0e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:15.227699 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4871d5f8-a4fd-4f8e-b350-87c1a222ea52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:15.233665 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4871d5f8-a4fd-4f8e-b350-87c1a222ea52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:15.234168 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4871d5f8-a4fd-4f8e-b350-87c1a222ea52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:15.234606 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4871d5f8-a4fd-4f8e-b350-87c1a222ea52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:15.235300 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4871d5f8-a4fd-4f8e-b350-87c1a222ea52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:15.235670 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9289dda8-3dfb-4d71-9ba3-9f1f3f535c0e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.151167 Aug 24 17:57:15.235783 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4871d5f8-a4fd-4f8e-b350-87c1a222ea52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:15.236193 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4871d5f8-a4fd-4f8e-b350-87c1a222ea52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:15.236305 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 479/933] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:15 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:15.368481 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-4871d5f8-a4fd-4f8e-b350-87c1a222ea52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:15.376685 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4871d5f8-a4fd-4f8e-b350-87c1a222ea52 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 200 len: 1368 microversion: 2.1 time: 0.154661 Aug 24 17:57:15.377246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 455/934] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:15 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:57:16.257309 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-319148bf-29f5-4f5f-96ed-0544cef9451d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:16.257835 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-319148bf-29f5-4f5f-96ed-0544cef9451d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:16.264296 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-319148bf-29f5-4f5f-96ed-0544cef9451d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:16.264781 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-319148bf-29f5-4f5f-96ed-0544cef9451d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:16.265214 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-319148bf-29f5-4f5f-96ed-0544cef9451d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:16.265909 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-319148bf-29f5-4f5f-96ed-0544cef9451d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:16.266365 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-319148bf-29f5-4f5f-96ed-0544cef9451d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:16.266791 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-319148bf-29f5-4f5f-96ed-0544cef9451d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:16.397624 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e59c8d88-23b3-451b-9a0d-2423b95ab2ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:16.398278 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-e59c8d88-23b3-451b-9a0d-2423b95ab2ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:16.399660 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-319148bf-29f5-4f5f-96ed-0544cef9451d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:16.405129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e59c8d88-23b3-451b-9a0d-2423b95ab2ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:16.405618 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e59c8d88-23b3-451b-9a0d-2423b95ab2ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:16.406060 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e59c8d88-23b3-451b-9a0d-2423b95ab2ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:16.406792 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e59c8d88-23b3-451b-9a0d-2423b95ab2ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:16.407251 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e59c8d88-23b3-451b-9a0d-2423b95ab2ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:16.407710 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-e59c8d88-23b3-451b-9a0d-2423b95ab2ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:16.408599 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-319148bf-29f5-4f5f-96ed-0544cef9451d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.155245 Aug 24 17:57:16.409161 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 480/935] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:16 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:16.535883 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-e59c8d88-23b3-451b-9a0d-2423b95ab2ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:16.543554 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e59c8d88-23b3-451b-9a0d-2423b95ab2ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 200 len: 1559 microversion: 2.1 time: 0.149787 Aug 24 17:57:16.544373 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 456/936] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:16 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:57:16.564070 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1ce7d99b-fb2b-4d7a-bff8-104bc16a0064 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:16.564560 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1ce7d99b-fb2b-4d7a-bff8-104bc16a0064 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:16.570401 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1ce7d99b-fb2b-4d7a-bff8-104bc16a0064 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:16.570882 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1ce7d99b-fb2b-4d7a-bff8-104bc16a0064 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:16.571314 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1ce7d99b-fb2b-4d7a-bff8-104bc16a0064 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:16.572295 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1ce7d99b-fb2b-4d7a-bff8-104bc16a0064 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:16.572746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1ce7d99b-fb2b-4d7a-bff8-104bc16a0064 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:16.573675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1ce7d99b-fb2b-4d7a-bff8-104bc16a0064 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:16.649088 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1ce7d99b-fb2b-4d7a-bff8-104bc16a0064 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088775 Aug 24 17:57:16.649701 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 481/937] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 17:57:16 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:57:17.430198 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-435608b6-1b96-4668-8405-6f52868ddd6d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:17.430937 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-435608b6-1b96-4668-8405-6f52868ddd6d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:17.433468 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:17.434179 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=10 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:17.440650 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-435608b6-1b96-4668-8405-6f52868ddd6d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:17.441175 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-435608b6-1b96-4668-8405-6f52868ddd6d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:17.441668 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-435608b6-1b96-4668-8405-6f52868ddd6d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:17.442376 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-435608b6-1b96-4668-8405-6f52868ddd6d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:17.442834 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-435608b6-1b96-4668-8405-6f52868ddd6d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:17.443264 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-435608b6-1b96-4668-8405-6f52868ddd6d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:17.555174 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:17.561090 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-04d7f811-0c37-4de6-85ea-190a5fe85b2c req-251be794-3cb0-44ba-a13e-6ee092cb08ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ddeacc2-9845-45e4-a64e-4ee00365b530", "tag": "04238239-ff09-4a67-aedd-1b913bf3958d"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:17.571064 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-04d7f811-0c37-4de6-85ea-190a5fe85b2c req-251be794-3cb0-44ba-a13e-6ee092cb08ce service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:17.571920 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-04d7f811-0c37-4de6-85ea-190a5fe85b2c req-251be794-3cb0-44ba-a13e-6ee092cb08ce service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:17.572436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-04d7f811-0c37-4de6-85ea-190a5fe85b2c req-251be794-3cb0-44ba-a13e-6ee092cb08ce service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:17.584363 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-04d7f811-0c37-4de6-85ea-190a5fe85b2c req-251be794-3cb0-44ba-a13e-6ee092cb08ce service nova] Creating event network-changed:04238239-ff09-4a67-aedd-1b913bf3958d for instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 on hv-cinder-84052 Aug 24 17:57:17.586966 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-435608b6-1b96-4668-8405-6f52868ddd6d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:17.589463 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-04d7f811-0c37-4de6-85ea-190a5fe85b2c req-251be794-3cb0-44ba-a13e-6ee092cb08ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034842 Aug 24 17:57:17.590374 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 482/938] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:57:17.595914 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-435608b6-1b96-4668-8405-6f52868ddd6d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1725 microversion: 2.1 time: 0.169662 Aug 24 17:57:17.596575 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 457/939] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:17 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:18.618160 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-cba447ff-8e10-4b13-b275-c5fd66ad51b2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:18.618780 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-cba447ff-8e10-4b13-b275-c5fd66ad51b2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:18.625479 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cba447ff-8e10-4b13-b275-c5fd66ad51b2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:18.625966 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cba447ff-8e10-4b13-b275-c5fd66ad51b2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:18.626402 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cba447ff-8e10-4b13-b275-c5fd66ad51b2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:18.627096 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cba447ff-8e10-4b13-b275-c5fd66ad51b2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:18.627580 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cba447ff-8e10-4b13-b275-c5fd66ad51b2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:18.628007 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cba447ff-8e10-4b13-b275-c5fd66ad51b2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:18.762231 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-cba447ff-8e10-4b13-b275-c5fd66ad51b2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:18.770490 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-cba447ff-8e10-4b13-b275-c5fd66ad51b2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1702 microversion: 2.1 time: 0.157200 Aug 24 17:57:18.771058 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 483/940] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:18 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1702 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:18.790569 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7ee16704-00fa-4702-8102-88be6197a367 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:18.797470 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ee16704-00fa-4702-8102-88be6197a367 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:18.797944 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ee16704-00fa-4702-8102-88be6197a367 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:18.798370 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ee16704-00fa-4702-8102-88be6197a367 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:18.856046 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7ee16704-00fa-4702-8102-88be6197a367 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Going to try to start instance {{(pid=126993) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 17:57:18.896890 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7ee16704-00fa-4702-8102-88be6197a367 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "POST /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/action" status: 202 len: 0 microversion: 2.1 time: 0.109996 Aug 24 17:57:18.897394 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 458/941] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:57:18 2022] POST /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:57:18.906683 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-753afc11-2c60-464d-b81f-83e6c65c72ec tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:18.907390 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-753afc11-2c60-464d-b81f-83e6c65c72ec tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:18.914095 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-753afc11-2c60-464d-b81f-83e6c65c72ec tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:18.914586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-753afc11-2c60-464d-b81f-83e6c65c72ec tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:18.915152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-753afc11-2c60-464d-b81f-83e6c65c72ec tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:18.915871 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-753afc11-2c60-464d-b81f-83e6c65c72ec tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:18.916331 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-753afc11-2c60-464d-b81f-83e6c65c72ec tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:18.917413 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-753afc11-2c60-464d-b81f-83e6c65c72ec tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:19.050728 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-753afc11-2c60-464d-b81f-83e6c65c72ec tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:19.054297 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=100 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:19.060303 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-753afc11-2c60-464d-b81f-83e6c65c72ec tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1711 microversion: 2.1 time: 0.157461 Aug 24 17:57:19.060859 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 484/942] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:18 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1711 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:57:20.082848 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8e4d639f-ff0a-4287-ba5b-ed8bbf9ac6ca tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:20.083600 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8e4d639f-ff0a-4287-ba5b-ed8bbf9ac6ca tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:20.090477 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8e4d639f-ff0a-4287-ba5b-ed8bbf9ac6ca tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:20.090967 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8e4d639f-ff0a-4287-ba5b-ed8bbf9ac6ca tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:20.091403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8e4d639f-ff0a-4287-ba5b-ed8bbf9ac6ca tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:20.092128 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8e4d639f-ff0a-4287-ba5b-ed8bbf9ac6ca tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:20.092589 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8e4d639f-ff0a-4287-ba5b-ed8bbf9ac6ca tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:20.093019 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8e4d639f-ff0a-4287-ba5b-ed8bbf9ac6ca tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:20.220864 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8e4d639f-ff0a-4287-ba5b-ed8bbf9ac6ca tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:20.230756 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8e4d639f-ff0a-4287-ba5b-ed8bbf9ac6ca tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1711 microversion: 2.1 time: 0.150905 Aug 24 17:57:20.231367 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 459/943] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:20 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1711 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:21.252326 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-53e22301-0a0e-4283-b88f-451c225f0d01 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:21.252930 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-53e22301-0a0e-4283-b88f-451c225f0d01 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:21.261020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-53e22301-0a0e-4283-b88f-451c225f0d01 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:21.261514 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-53e22301-0a0e-4283-b88f-451c225f0d01 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:21.261958 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-53e22301-0a0e-4283-b88f-451c225f0d01 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:21.262659 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-53e22301-0a0e-4283-b88f-451c225f0d01 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:21.263147 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-53e22301-0a0e-4283-b88f-451c225f0d01 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:21.263598 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-53e22301-0a0e-4283-b88f-451c225f0d01 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:21.392786 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-53e22301-0a0e-4283-b88f-451c225f0d01 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:21.401018 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-53e22301-0a0e-4283-b88f-451c225f0d01 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1715 microversion: 2.1 time: 0.152608 Aug 24 17:57:21.402074 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 485/944] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:21 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:53.761704 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1b468f6a-f2bb-4afb-af46-3e6526d19a15 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:53.762331 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1b468f6a-f2bb-4afb-af46-3e6526d19a15 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:53.764415 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:53.765251 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:53.770937 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1b468f6a-f2bb-4afb-af46-3e6526d19a15 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:53.771424 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1b468f6a-f2bb-4afb-af46-3e6526d19a15 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:53.771887 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1b468f6a-f2bb-4afb-af46-3e6526d19a15 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:53.772633 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1b468f6a-f2bb-4afb-af46-3e6526d19a15 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:53.773072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1b468f6a-f2bb-4afb-af46-3e6526d19a15 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:53.773497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1b468f6a-f2bb-4afb-af46-3e6526d19a15 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:53.798021 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1b468f6a-f2bb-4afb-af46-3e6526d19a15 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530/ips" status: 200 len: 149 microversion: 2.1 time: 0.041054 Aug 24 17:57:53.798583 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 460/945] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 17:57:53 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:57:54.673454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-98b87631-573f-4b96-8f10-0019d5c75330 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:54.674021 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-98b87631-573f-4b96-8f10-0019d5c75330 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:54.676217 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=33 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:54.676870 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=6 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:57:54.682361 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98b87631-573f-4b96-8f10-0019d5c75330 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:54.682844 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98b87631-573f-4b96-8f10-0019d5c75330 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:54.683284 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98b87631-573f-4b96-8f10-0019d5c75330 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:54.684005 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98b87631-573f-4b96-8f10-0019d5c75330 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:54.684464 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98b87631-573f-4b96-8f10-0019d5c75330 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:54.684891 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-98b87631-573f-4b96-8f10-0019d5c75330 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:54.903411 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.objects.instance [None req-98b87631-573f-4b96-8f10-0019d5c75330 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lazy-loading 'services' on Instance uuid 1fbbd365-963e-4126-835c-d2a1725dfd77 {{(pid=126994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:57:54.973938 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-98b87631-573f-4b96-8f10-0019d5c75330 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/os-volume_attachments/3ddfee43-2755-47ce-98e2-216b7580b3ce" status: 202 len: 0 microversion: 2.1 time: 0.304283 Aug 24 17:57:54.974508 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 486/946] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 17:57:54 2022] DELETE /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/os-volume_attachments/3ddfee43-2755-47ce-98e2-216b7580b3ce => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:57:55.122437 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5d7058be-0de1-4d11-a6dc-7e29ab114995 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "187e5d46-56f1-4dde-b51c-32c93775cf3b"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:55.124784 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5d7058be-0de1-4d11-a6dc-7e29ab114995 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:55.131220 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d7058be-0de1-4d11-a6dc-7e29ab114995 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:55.131737 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d7058be-0de1-4d11-a6dc-7e29ab114995 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:55.132174 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d7058be-0de1-4d11-a6dc-7e29ab114995 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:55.132868 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d7058be-0de1-4d11-a6dc-7e29ab114995 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:55.133329 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d7058be-0de1-4d11-a6dc-7e29ab114995 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:55.133779 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5d7058be-0de1-4d11-a6dc-7e29ab114995 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:55.601953 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5d7058be-0de1-4d11-a6dc-7e29ab114995 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "POST /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483114 Aug 24 17:57:55.602578 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 461/947] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:57:55 2022] POST /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:57:56.111933 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9eecbc55-79b5-47de-a895-188b6e881c70 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:57:56.118162 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9eecbc55-79b5-47de-a895-188b6e881c70 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:56.118657 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9eecbc55-79b5-47de-a895-188b6e881c70 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:56.119692 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9eecbc55-79b5-47de-a895-188b6e881c70 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:56.141373 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9eecbc55-79b5-47de-a895-188b6e881c70 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Going to try to stop instance {{(pid=126994) force_stop /opt/stack/nova/nova/compute/api.py:2760}} Aug 24 17:57:56.182821 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9eecbc55-79b5-47de-a895-188b6e881c70 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "POST /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/action" status: 202 len: 0 microversion: 2.1 time: 0.075515 Aug 24 17:57:56.183428 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 487/948] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:57:56 2022] POST /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:57:56.192793 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8bdc3c62-d880-4165-b495-b65e77c51ef5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:56.193485 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8bdc3c62-d880-4165-b495-b65e77c51ef5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:56.201255 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8bdc3c62-d880-4165-b495-b65e77c51ef5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:56.201736 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8bdc3c62-d880-4165-b495-b65e77c51ef5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:56.202216 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8bdc3c62-d880-4165-b495-b65e77c51ef5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:56.202991 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8bdc3c62-d880-4165-b495-b65e77c51ef5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:56.203425 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8bdc3c62-d880-4165-b495-b65e77c51ef5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:56.203875 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8bdc3c62-d880-4165-b495-b65e77c51ef5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:56.341385 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-8bdc3c62-d880-4165-b495-b65e77c51ef5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:56.349116 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8bdc3c62-d880-4165-b495-b65e77c51ef5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1679 microversion: 2.1 time: 0.160732 Aug 24 17:57:56.349676 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 462/949] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:56 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:57.371388 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1c29c316-4ffd-4a3c-97ca-dedee4028ff2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:57.372131 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1c29c316-4ffd-4a3c-97ca-dedee4028ff2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:57.378284 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1c29c316-4ffd-4a3c-97ca-dedee4028ff2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:57.378772 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1c29c316-4ffd-4a3c-97ca-dedee4028ff2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:57.379210 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1c29c316-4ffd-4a3c-97ca-dedee4028ff2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:57.379953 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1c29c316-4ffd-4a3c-97ca-dedee4028ff2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:57.380416 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1c29c316-4ffd-4a3c-97ca-dedee4028ff2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:57.380845 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1c29c316-4ffd-4a3c-97ca-dedee4028ff2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:57.509212 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1c29c316-4ffd-4a3c-97ca-dedee4028ff2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:57.517532 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1c29c316-4ffd-4a3c-97ca-dedee4028ff2 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1679 microversion: 2.1 time: 0.151330 Aug 24 17:57:57.518099 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 488/950] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:57 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:58.538887 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-6c3812da-ed49-4d5f-8ec2-712434c649bd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:58.539552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-6c3812da-ed49-4d5f-8ec2-712434c649bd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:58.546468 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6c3812da-ed49-4d5f-8ec2-712434c649bd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:58.546946 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6c3812da-ed49-4d5f-8ec2-712434c649bd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:58.547381 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6c3812da-ed49-4d5f-8ec2-712434c649bd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:58.548088 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6c3812da-ed49-4d5f-8ec2-712434c649bd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:58.548539 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6c3812da-ed49-4d5f-8ec2-712434c649bd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:58.548953 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-6c3812da-ed49-4d5f-8ec2-712434c649bd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:58.684627 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-6c3812da-ed49-4d5f-8ec2-712434c649bd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:58.692305 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-6c3812da-ed49-4d5f-8ec2-712434c649bd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1679 microversion: 2.1 time: 0.157293 Aug 24 17:57:58.692862 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 463/951] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:58 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:57:59.714414 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9308ce5f-44a3-4cf0-90f5-2c36ef25a4fc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:57:59.715025 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9308ce5f-44a3-4cf0-90f5-2c36ef25a4fc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:57:59.721444 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9308ce5f-44a3-4cf0-90f5-2c36ef25a4fc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:59.721930 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9308ce5f-44a3-4cf0-90f5-2c36ef25a4fc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:59.722366 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9308ce5f-44a3-4cf0-90f5-2c36ef25a4fc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:59.723054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9308ce5f-44a3-4cf0-90f5-2c36ef25a4fc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:57:59.723531 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9308ce5f-44a3-4cf0-90f5-2c36ef25a4fc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:57:59.723962 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9308ce5f-44a3-4cf0-90f5-2c36ef25a4fc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:57:59.852549 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-9308ce5f-44a3-4cf0-90f5-2c36ef25a4fc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:57:59.860960 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9308ce5f-44a3-4cf0-90f5-2c36ef25a4fc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1679 microversion: 2.1 time: 0.150770 Aug 24 17:57:59.861530 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 489/952] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:57:59 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:00.882221 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ddfaa844-91df-44bc-b609-18d794bbd14f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:00.882743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ddfaa844-91df-44bc-b609-18d794bbd14f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:00.889686 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ddfaa844-91df-44bc-b609-18d794bbd14f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:00.890172 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ddfaa844-91df-44bc-b609-18d794bbd14f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:00.890613 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ddfaa844-91df-44bc-b609-18d794bbd14f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:00.891318 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ddfaa844-91df-44bc-b609-18d794bbd14f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:00.891806 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ddfaa844-91df-44bc-b609-18d794bbd14f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:00.892235 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ddfaa844-91df-44bc-b609-18d794bbd14f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:01.077908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ddfaa844-91df-44bc-b609-18d794bbd14f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:01.085769 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ddfaa844-91df-44bc-b609-18d794bbd14f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1679 microversion: 2.1 time: 0.207524 Aug 24 17:58:01.086333 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 464/953] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:00 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:02.108483 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ca613e19-129d-450a-b04d-266792ebf333 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:02.109171 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ca613e19-129d-450a-b04d-266792ebf333 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:02.116098 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca613e19-129d-450a-b04d-266792ebf333 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:02.116591 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca613e19-129d-450a-b04d-266792ebf333 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:02.117033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca613e19-129d-450a-b04d-266792ebf333 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:02.117736 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca613e19-129d-450a-b04d-266792ebf333 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:02.118208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca613e19-129d-450a-b04d-266792ebf333 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:02.119313 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ca613e19-129d-450a-b04d-266792ebf333 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:02.261642 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ca613e19-129d-450a-b04d-266792ebf333 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:02.269490 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ca613e19-129d-450a-b04d-266792ebf333 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1656 microversion: 2.1 time: 0.165388 Aug 24 17:58:02.270069 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 490/954] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:02 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1656 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:02.289389 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2b59f3fb-a355-4c37-9d66-6588e96d5c78 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:02.296443 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2b59f3fb-a355-4c37-9d66-6588e96d5c78 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:02.296934 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2b59f3fb-a355-4c37-9d66-6588e96d5c78 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:02.297379 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2b59f3fb-a355-4c37-9d66-6588e96d5c78 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:02.319707 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2b59f3fb-a355-4c37-9d66-6588e96d5c78 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Going to try to start instance {{(pid=126993) start /opt/stack/nova/nova/compute/api.py:2783}} Aug 24 17:58:02.361476 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2b59f3fb-a355-4c37-9d66-6588e96d5c78 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "POST /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/action" status: 202 len: 0 microversion: 2.1 time: 0.075713 Aug 24 17:58:02.362074 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 465/955] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Aug 24 17:58:02 2022] POST /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:58:02.370765 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-91a3825c-0b5e-454e-ba99-7951937f5f3c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:02.371483 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-91a3825c-0b5e-454e-ba99-7951937f5f3c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:02.377689 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-91a3825c-0b5e-454e-ba99-7951937f5f3c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:02.378292 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-91a3825c-0b5e-454e-ba99-7951937f5f3c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:02.378768 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-91a3825c-0b5e-454e-ba99-7951937f5f3c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:02.379504 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-91a3825c-0b5e-454e-ba99-7951937f5f3c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:02.379981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-91a3825c-0b5e-454e-ba99-7951937f5f3c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:02.380402 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-91a3825c-0b5e-454e-ba99-7951937f5f3c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:02.513940 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-91a3825c-0b5e-454e-ba99-7951937f5f3c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:02.521520 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-91a3825c-0b5e-454e-ba99-7951937f5f3c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1665 microversion: 2.1 time: 0.155127 Aug 24 17:58:02.522652 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 491/956] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:02 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:03.227456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-122a8f00-8fc4-41d1-bc13-f460ec7d84fd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:03.228096 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-122a8f00-8fc4-41d1-bc13-f460ec7d84fd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:03.234233 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-122a8f00-8fc4-41d1-bc13-f460ec7d84fd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:03.234719 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-122a8f00-8fc4-41d1-bc13-f460ec7d84fd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:03.235155 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-122a8f00-8fc4-41d1-bc13-f460ec7d84fd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:03.235879 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-122a8f00-8fc4-41d1-bc13-f460ec7d84fd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:03.236341 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-122a8f00-8fc4-41d1-bc13-f460ec7d84fd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:03.236766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-122a8f00-8fc4-41d1-bc13-f460ec7d84fd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:03.316165 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-122a8f00-8fc4-41d1-bc13-f460ec7d84fd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lazy-loading 'services' on Instance uuid 2ddeacc2-9845-45e4-a64e-4ee00365b530 {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:58:03.389943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-122a8f00-8fc4-41d1-bc13-f460ec7d84fd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530/os-volume_attachments/187e5d46-56f1-4dde-b51c-32c93775cf3b" status: 202 len: 0 microversion: 2.1 time: 0.166654 Aug 24 17:58:03.390552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 466/957] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 17:58:03 2022] DELETE /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530/os-volume_attachments/187e5d46-56f1-4dde-b51c-32c93775cf3b => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:58:03.399018 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7e4d6498-b6d1-4452-b71c-531944a2d0dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:03.401808 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7e4d6498-b6d1-4452-b71c-531944a2d0dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:03.408216 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e4d6498-b6d1-4452-b71c-531944a2d0dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:03.408706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e4d6498-b6d1-4452-b71c-531944a2d0dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:03.409154 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e4d6498-b6d1-4452-b71c-531944a2d0dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:03.409850 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e4d6498-b6d1-4452-b71c-531944a2d0dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:03.410312 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e4d6498-b6d1-4452-b71c-531944a2d0dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:03.410742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7e4d6498-b6d1-4452-b71c-531944a2d0dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:03.440021 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7e4d6498-b6d1-4452-b71c-531944a2d0dd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 Aug 24 17:58:03.440564 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 492/958] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:58:03 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:03.543647 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1bfb2b06-44cb-4a2f-b70f-29e56db67cc7 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:03.544351 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1bfb2b06-44cb-4a2f-b70f-29e56db67cc7 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:03.550570 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1bfb2b06-44cb-4a2f-b70f-29e56db67cc7 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:03.551052 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1bfb2b06-44cb-4a2f-b70f-29e56db67cc7 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:03.551504 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1bfb2b06-44cb-4a2f-b70f-29e56db67cc7 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:03.552251 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1bfb2b06-44cb-4a2f-b70f-29e56db67cc7 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:03.552706 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1bfb2b06-44cb-4a2f-b70f-29e56db67cc7 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:03.553129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1bfb2b06-44cb-4a2f-b70f-29e56db67cc7 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:03.686778 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-1bfb2b06-44cb-4a2f-b70f-29e56db67cc7 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:03.694730 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1bfb2b06-44cb-4a2f-b70f-29e56db67cc7 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1665 microversion: 2.1 time: 0.155743 Aug 24 17:58:03.695296 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 467/959] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:03 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:04.452703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-908778e2-f0e8-4f55-85bc-e77ff87e86f5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:04.454957 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-908778e2-f0e8-4f55-85bc-e77ff87e86f5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:04.461319 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-908778e2-f0e8-4f55-85bc-e77ff87e86f5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:04.461835 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-908778e2-f0e8-4f55-85bc-e77ff87e86f5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:04.462366 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-908778e2-f0e8-4f55-85bc-e77ff87e86f5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:04.463093 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-908778e2-f0e8-4f55-85bc-e77ff87e86f5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:04.463587 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-908778e2-f0e8-4f55-85bc-e77ff87e86f5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:04.464013 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-908778e2-f0e8-4f55-85bc-e77ff87e86f5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:04.494004 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-908778e2-f0e8-4f55-85bc-e77ff87e86f5 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044817 Aug 24 17:58:04.494886 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 493/960] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:58:04 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:58:04.555244 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-731de9d0-23a4-4d7e-ac3c-b39c7203abb9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:04.555852 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-731de9d0-23a4-4d7e-ac3c-b39c7203abb9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:04.562816 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-731de9d0-23a4-4d7e-ac3c-b39c7203abb9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:04.563373 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-731de9d0-23a4-4d7e-ac3c-b39c7203abb9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:04.563845 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-731de9d0-23a4-4d7e-ac3c-b39c7203abb9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:04.564538 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-731de9d0-23a4-4d7e-ac3c-b39c7203abb9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:04.565001 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-731de9d0-23a4-4d7e-ac3c-b39c7203abb9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:04.565424 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-731de9d0-23a4-4d7e-ac3c-b39c7203abb9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:04.589901 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-731de9d0-23a4-4d7e-ac3c-b39c7203abb9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:58:04.664994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-731de9d0-23a4-4d7e-ac3c-b39c7203abb9 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 204 len: 0 microversion: 2.1 time: 0.113377 Aug 24 17:58:04.666258 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 468/961] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:58:04 2022] DELETE /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 17:58:04.674353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5eeedb91-19ae-4bb2-8bcc-d86042352c3d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:04.674959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5eeedb91-19ae-4bb2-8bcc-d86042352c3d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:04.681029 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5eeedb91-19ae-4bb2-8bcc-d86042352c3d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:04.681511 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5eeedb91-19ae-4bb2-8bcc-d86042352c3d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:04.681952 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5eeedb91-19ae-4bb2-8bcc-d86042352c3d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:04.682640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5eeedb91-19ae-4bb2-8bcc-d86042352c3d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:04.683098 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5eeedb91-19ae-4bb2-8bcc-d86042352c3d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:04.683548 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5eeedb91-19ae-4bb2-8bcc-d86042352c3d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:04.717322 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-99fbd82e-02e2-4dad-b6dd-426c7f44da17 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:04.718034 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-99fbd82e-02e2-4dad-b6dd-426c7f44da17 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:04.724010 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-99fbd82e-02e2-4dad-b6dd-426c7f44da17 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:04.724496 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-99fbd82e-02e2-4dad-b6dd-426c7f44da17 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:04.724935 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-99fbd82e-02e2-4dad-b6dd-426c7f44da17 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:04.725642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-99fbd82e-02e2-4dad-b6dd-426c7f44da17 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:04.726099 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-99fbd82e-02e2-4dad-b6dd-426c7f44da17 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:04.726523 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-99fbd82e-02e2-4dad-b6dd-426c7f44da17 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:04.817073 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5eeedb91-19ae-4bb2-8bcc-d86042352c3d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:04.825537 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5eeedb91-19ae-4bb2-8bcc-d86042352c3d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 200 len: 1682 microversion: 2.1 time: 0.155029 Aug 24 17:58:04.826098 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 494/962] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:04 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:04.860621 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-99fbd82e-02e2-4dad-b6dd-426c7f44da17 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:04.868998 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-99fbd82e-02e2-4dad-b6dd-426c7f44da17 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1669 microversion: 2.1 time: 0.155340 Aug 24 17:58:04.869560 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 469/963] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:04 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:58:05.847151 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-527f03d1-d310-4fe6-ae20-c77049b90e16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:05.847748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-527f03d1-d310-4fe6-ae20-c77049b90e16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:05.854249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-527f03d1-d310-4fe6-ae20-c77049b90e16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:05.854739 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-527f03d1-d310-4fe6-ae20-c77049b90e16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:05.855180 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-527f03d1-d310-4fe6-ae20-c77049b90e16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:05.855909 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-527f03d1-d310-4fe6-ae20-c77049b90e16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:05.856359 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-527f03d1-d310-4fe6-ae20-c77049b90e16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:05.856783 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-527f03d1-d310-4fe6-ae20-c77049b90e16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:05.983012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-527f03d1-d310-4fe6-ae20-c77049b90e16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:05.990673 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-527f03d1-d310-4fe6-ae20-c77049b90e16 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 200 len: 1682 microversion: 2.1 time: 0.147458 Aug 24 17:58:05.991234 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 495/964] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:05 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:06.997398 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-c18a7e75-7e14-4262-9ef2-287fcf635566 req-d764c8d7-c0e9-4bd1-a64c-44ebe1aadaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ddeacc2-9845-45e4-a64e-4ee00365b530", "name": "network-vif-deleted", "tag": "04238239-ff09-4a67-aedd-1b913bf3958d"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:07.017755 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-c18a7e75-7e14-4262-9ef2-287fcf635566 req-d764c8d7-c0e9-4bd1-a64c-44ebe1aadaf8 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:07.018352 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8452dfdf-5a4a-426d-8fcd-383807d6910c tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:07.018954 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8452dfdf-5a4a-426d-8fcd-383807d6910c tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:07.019101 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-c18a7e75-7e14-4262-9ef2-287fcf635566 req-d764c8d7-c0e9-4bd1-a64c-44ebe1aadaf8 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:07.019581 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-c18a7e75-7e14-4262-9ef2-287fcf635566 req-d764c8d7-c0e9-4bd1-a64c-44ebe1aadaf8 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:07.033236 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-c18a7e75-7e14-4262-9ef2-287fcf635566 req-d764c8d7-c0e9-4bd1-a64c-44ebe1aadaf8 service nova] Creating event network-vif-deleted:04238239-ff09-4a67-aedd-1b913bf3958d for instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 on hv-cinder-84052 Aug 24 17:58:07.034160 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8452dfdf-5a4a-426d-8fcd-383807d6910c tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:07.035140 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8452dfdf-5a4a-426d-8fcd-383807d6910c tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:07.035723 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8452dfdf-5a4a-426d-8fcd-383807d6910c tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:07.036569 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8452dfdf-5a4a-426d-8fcd-383807d6910c tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:07.037150 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8452dfdf-5a4a-426d-8fcd-383807d6910c tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:07.037841 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8452dfdf-5a4a-426d-8fcd-383807d6910c tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:07.050286 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-c18a7e75-7e14-4262-9ef2-287fcf635566 req-d764c8d7-c0e9-4bd1-a64c-44ebe1aadaf8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056717 Aug 24 17:58:07.052264 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 470/965] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:07.116432 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8452dfdf-5a4a-426d-8fcd-383807d6910c tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b9d2b042c04927b9115085fcb4ba40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '625652cfa47248faac8c1f7759c56a14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:07.127964 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8452dfdf-5a4a-426d-8fcd-383807d6910c tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 200 len: 1327 microversion: 2.1 time: 0.113472 Aug 24 17:58:07.128792 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 496/966] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:07 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:08.151813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b29f4d90-042f-4771-af5d-5252ef68b42d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:08.152877 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b29f4d90-042f-4771-af5d-5252ef68b42d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:08.159865 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b29f4d90-042f-4771-af5d-5252ef68b42d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:08.160359 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b29f4d90-042f-4771-af5d-5252ef68b42d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:08.160797 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b29f4d90-042f-4771-af5d-5252ef68b42d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:08.161491 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b29f4d90-042f-4771-af5d-5252ef68b42d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:08.161950 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b29f4d90-042f-4771-af5d-5252ef68b42d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:08.162376 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b29f4d90-042f-4771-af5d-5252ef68b42d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:08.175457 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-b29f4d90-042f-4771-af5d-5252ef68b42d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b29f4d90-042f-4771-af5d-5252ef68b42d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 HTTP/1.1 Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:58:08.177129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:58:08.178800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:58:08.178800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:08.178800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:08.178800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:08.178800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:08.178800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:58:08.178800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:58:08.178800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:58:08.178800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:08.178800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:58:08.178800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:08.178800 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '2ddeacc2-9845-45e4-a64e-4ee00365b530'} Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:08.179813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:08.181386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:08.182773 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b29f4d90-042f-4771-af5d-5252ef68b42d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 404 to user: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:08.182773 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b29f4d90-042f-4771-af5d-5252ef68b42d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 404 len: 111 microversion: 2.1 time: 0.032686 Aug 24 17:58:08.182773 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 471/967] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:08 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:58:08.187602 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-db37fed9-343c-468a-a93c-e75d45fbeacd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '.version_select at 0x7f4b296c4b80>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:08.207189 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-db37fed9-343c-468a-a93c-e75d45fbeacd tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280211702" status: 202 len: 0 microversion: 2.1 time: 0.023298 Aug 24 17:58:08.207708 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 497/968] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 24 17:58:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280211702 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:58:09.926638 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-434018d2-9e7d-4129-9686-de73cfdb2f0d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:09.927130 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-434018d2-9e7d-4129-9686-de73cfdb2f0d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:09.933991 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-434018d2-9e7d-4129-9686-de73cfdb2f0d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:09.934466 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-434018d2-9e7d-4129-9686-de73cfdb2f0d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:09.934892 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-434018d2-9e7d-4129-9686-de73cfdb2f0d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:09.935609 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-434018d2-9e7d-4129-9686-de73cfdb2f0d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:09.936061 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-434018d2-9e7d-4129-9686-de73cfdb2f0d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:09.936480 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-434018d2-9e7d-4129-9686-de73cfdb2f0d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:09.950459 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-434018d2-9e7d-4129-9686-de73cfdb2f0d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-434018d2-9e7d-4129-9686-de73cfdb2f0d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: DELETE /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 HTTP/1.1 Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:58:09.952009 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:58:09.953653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:58:09.953653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:09.953653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:09.953653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:09.953653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:09.953653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:58:09.953653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:58:09.953653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:58:09.953653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:09.953653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:58:09.953653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:09.953653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '2ddeacc2-9845-45e4-a64e-4ee00365b530'} Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:09.954493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:09.955840 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:09.957110 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-434018d2-9e7d-4129-9686-de73cfdb2f0d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 404 to user: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:09.957110 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-434018d2-9e7d-4129-9686-de73cfdb2f0d tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 404 len: 111 microversion: 2.1 time: 0.030580 Aug 24 17:58:09.957110 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 472/969] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:58:09 2022] DELETE /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:09.961686 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0454e2e7-1cc6-447a-8ae2-78440be304d7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:09.962303 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-0454e2e7-1cc6-447a-8ae2-78440be304d7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2ddeacc2-9845-45e4-a64e-4ee00365b530] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:09.969251 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0454e2e7-1cc6-447a-8ae2-78440be304d7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:09.969742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0454e2e7-1cc6-447a-8ae2-78440be304d7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:09.970176 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0454e2e7-1cc6-447a-8ae2-78440be304d7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:09.970866 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0454e2e7-1cc6-447a-8ae2-78440be304d7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:09.971350 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0454e2e7-1cc6-447a-8ae2-78440be304d7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:09.971798 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-0454e2e7-1cc6-447a-8ae2-78440be304d7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:09.984458 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-0454e2e7-1cc6-447a-8ae2-78440be304d7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0454e2e7-1cc6-447a-8ae2-78440be304d7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 HTTP/1.1 Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:58:09.986101 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:58:09.987789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:58:09.987789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:09.987789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:09.987789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:09.987789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:09.987789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:58:09.987789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:58:09.987789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:58:09.987789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:09.987789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:58:09.987789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:09.987789 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '2ddeacc2-9845-45e4-a64e-4ee00365b530'} Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:09.988704 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. Aug 24 17:58:09.990306 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:09.991956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-0454e2e7-1cc6-447a-8ae2-78440be304d7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 404 to user: Instance 2ddeacc2-9845-45e4-a64e-4ee00365b530 could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:09.991956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-0454e2e7-1cc6-447a-8ae2-78440be304d7 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530" status: 404 len: 111 microversion: 2.1 time: 0.029707 Aug 24 17:58:09.991956 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 498/970] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:09 2022] GET /compute/v2.1/servers/2ddeacc2-9845-45e4-a64e-4ee00365b530 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:58:11.142558 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-13000a91-1fd3-4c64-a7eb-a2f64ac13f89 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:11.143047 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-13000a91-1fd3-4c64-a7eb-a2f64ac13f89 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:11.149492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-13000a91-1fd3-4c64-a7eb-a2f64ac13f89 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:11.149974 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-13000a91-1fd3-4c64-a7eb-a2f64ac13f89 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:11.150410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-13000a91-1fd3-4c64-a7eb-a2f64ac13f89 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:11.151102 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-13000a91-1fd3-4c64-a7eb-a2f64ac13f89 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:11.151588 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-13000a91-1fd3-4c64-a7eb-a2f64ac13f89 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:11.152019 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-13000a91-1fd3-4c64-a7eb-a2f64ac13f89 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:11.165724 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-13000a91-1fd3-4c64-a7eb-a2f64ac13f89 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-13000a91-1fd3-4c64-a7eb-a2f64ac13f89 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: DELETE /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac HTTP/1.1 Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:58:11.167261 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:58:11.168908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:58:11.168908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:11.168908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:11.168908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:11.168908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:11.168908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:58:11.168908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:58:11.168908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:58:11.168908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:11.168908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:58:11.168908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:58:11.168908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '887986a8-3a8d-4a88-8aa4-a97a16e391ac'} Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:11.169830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:58:11.171386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.172919 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-13000a91-1fd3-4c64-a7eb-a2f64ac13f89 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 404 to user: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:11.172919 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-13000a91-1fd3-4c64-a7eb-a2f64ac13f89 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 404 len: 111 microversion: 2.1 time: 0.029985 Aug 24 17:58:11.172919 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 473/971] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:58:11 2022] DELETE /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:11.177001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-edfa7aec-3ec4-4250-9e5e-7fb86bbb910b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:11.177622 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-edfa7aec-3ec4-4250-9e5e-7fb86bbb910b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 887986a8-3a8d-4a88-8aa4-a97a16e391ac] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:11.184612 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-edfa7aec-3ec4-4250-9e5e-7fb86bbb910b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:11.185094 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-edfa7aec-3ec4-4250-9e5e-7fb86bbb910b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:11.185534 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-edfa7aec-3ec4-4250-9e5e-7fb86bbb910b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:11.186222 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-edfa7aec-3ec4-4250-9e5e-7fb86bbb910b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:11.186679 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-edfa7aec-3ec4-4250-9e5e-7fb86bbb910b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:11.187103 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-edfa7aec-3ec4-4250-9e5e-7fb86bbb910b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:11.200402 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-edfa7aec-3ec4-4250-9e5e-7fb86bbb910b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-edfa7aec-3ec4-4250-9e5e-7fb86bbb910b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac HTTP/1.1 Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:58:11.201944 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:58:11.203641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:58:11.203641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:11.203641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:11.203641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:11.203641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:11.203641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:58:11.203641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:58:11.203641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:58:11.203641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:11.203641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:58:11.203641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:58:11.203641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '887986a8-3a8d-4a88-8aa4-a97a16e391ac'} Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:11.204572 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. Aug 24 17:58:11.206163 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.207515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-edfa7aec-3ec4-4250-9e5e-7fb86bbb910b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 404 to user: Instance 887986a8-3a8d-4a88-8aa4-a97a16e391ac could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:11.207515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-edfa7aec-3ec4-4250-9e5e-7fb86bbb910b tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac" status: 404 len: 111 microversion: 2.1 time: 0.030218 Aug 24 17:58:11.207515 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 499/972] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:11 2022] GET /compute/v2.1/servers/887986a8-3a8d-4a88-8aa4-a97a16e391ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:11.211655 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1cc8e38a-a44f-4861-b077-b67d84f2df92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:11.212202 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-1cc8e38a-a44f-4861-b077-b67d84f2df92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:11.218167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1cc8e38a-a44f-4861-b077-b67d84f2df92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:11.218655 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1cc8e38a-a44f-4861-b077-b67d84f2df92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:11.219093 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1cc8e38a-a44f-4861-b077-b67d84f2df92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:11.219830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1cc8e38a-a44f-4861-b077-b67d84f2df92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:11.220290 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1cc8e38a-a44f-4861-b077-b67d84f2df92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:11.220721 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-1cc8e38a-a44f-4861-b077-b67d84f2df92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:11.234424 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-1cc8e38a-a44f-4861-b077-b67d84f2df92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1cc8e38a-a44f-4861-b077-b67d84f2df92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: DELETE /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 HTTP/1.1 Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:58:11.235923 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:58:11.237521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:58:11.237521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:11.237521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:11.237521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:11.237521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:11.237521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:58:11.237521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:58:11.237521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:58:11.237521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:11.237521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:58:11.237521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:58:11.237521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': 'dd9880c9-7222-4fa9-a5f0-2dbca7500cf2'} Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:11.238440 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:58:11.240020 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.241533 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1cc8e38a-a44f-4861-b077-b67d84f2df92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 404 to user: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:11.241533 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1cc8e38a-a44f-4861-b077-b67d84f2df92 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 404 len: 111 microversion: 2.1 time: 0.029449 Aug 24 17:58:11.241533 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 474/973] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:58:11 2022] DELETE /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:11.246016 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-632907bc-efc0-4dd2-9a83-c19c6f11c5ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:11.246666 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-632907bc-efc0-4dd2-9a83-c19c6f11c5ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: dd9880c9-7222-4fa9-a5f0-2dbca7500cf2] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:11.252634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-632907bc-efc0-4dd2-9a83-c19c6f11c5ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:11.253130 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-632907bc-efc0-4dd2-9a83-c19c6f11c5ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:11.253927 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-632907bc-efc0-4dd2-9a83-c19c6f11c5ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:11.254255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-632907bc-efc0-4dd2-9a83-c19c6f11c5ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:11.254725 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-632907bc-efc0-4dd2-9a83-c19c6f11c5ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:11.255152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-632907bc-efc0-4dd2-9a83-c19c6f11c5ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:11.270588 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-632907bc-efc0-4dd2-9a83-c19c6f11c5ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-632907bc-efc0-4dd2-9a83-c19c6f11c5ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 HTTP/1.1 Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:58:11.272155 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:58:11.273869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:58:11.273869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:11.273869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:11.273869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:11.273869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:11.273869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:58:11.273869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:58:11.273869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:58:11.273869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:11.273869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:58:11.273869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:58:11.273869 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': 'dd9880c9-7222-4fa9-a5f0-2dbca7500cf2'} Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:11.274706 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. Aug 24 17:58:11.276001 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:11.277172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-632907bc-efc0-4dd2-9a83-c19c6f11c5ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 404 to user: Instance dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:11.277172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-632907bc-efc0-4dd2-9a83-c19c6f11c5ff tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2" status: 404 len: 111 microversion: 2.1 time: 0.031976 Aug 24 17:58:11.277172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 500/974] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:11 2022] GET /compute/v2.1/servers/dd9880c9-7222-4fa9-a5f0-2dbca7500cf2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:12.410308 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ebc96386-a42a-49e7-9ee2-8786f83c0aef tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:12.410812 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ebc96386-a42a-49e7-9ee2-8786f83c0aef tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:12.417367 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebc96386-a42a-49e7-9ee2-8786f83c0aef tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:12.417852 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebc96386-a42a-49e7-9ee2-8786f83c0aef tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:12.418289 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebc96386-a42a-49e7-9ee2-8786f83c0aef tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:12.418983 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebc96386-a42a-49e7-9ee2-8786f83c0aef tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:12.419439 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebc96386-a42a-49e7-9ee2-8786f83c0aef tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:12.419893 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ebc96386-a42a-49e7-9ee2-8786f83c0aef tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:12.433597 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-ebc96386-a42a-49e7-9ee2-8786f83c0aef tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ebc96386-a42a-49e7-9ee2-8786f83c0aef tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: DELETE /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a HTTP/1.1 Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:58:12.435158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:58:12.436943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:58:12.436943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:12.436943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:12.436943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:12.436943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:12.436943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:58:12.436943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:58:12.436943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:58:12.436943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:12.436943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:58:12.436943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:58:12.436943 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '2e207e34-6199-4650-9358-5ef1fd30774a'} Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:12.438087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:58:12.439729 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:12.441246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ebc96386-a42a-49e7-9ee2-8786f83c0aef tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 404 to user: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:12.441246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ebc96386-a42a-49e7-9ee2-8786f83c0aef tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 404 len: 111 microversion: 2.1 time: 0.030141 Aug 24 17:58:12.441246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 475/975] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:58:12 2022] DELETE /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:12.445190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1e587dd3-27da-406a-b919-a530f8152db4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:12.445836 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1e587dd3-27da-406a-b919-a530f8152db4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] [instance: 2e207e34-6199-4650-9358-5ef1fd30774a] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:12.452961 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1e587dd3-27da-406a-b919-a530f8152db4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:12.453435 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1e587dd3-27da-406a-b919-a530f8152db4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:12.453875 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1e587dd3-27da-406a-b919-a530f8152db4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:12.454553 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1e587dd3-27da-406a-b919-a530f8152db4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:12.455000 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1e587dd3-27da-406a-b919-a530f8152db4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:12.455419 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1e587dd3-27da-406a-b919-a530f8152db4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:12.470029 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-1e587dd3-27da-406a-b919-a530f8152db4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] HTTP exception thrown: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1e587dd3-27da-406a-b919-a530f8152db4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Request method failure captured: Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a HTTP/1.1 Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmWoCs9I8AMsgJbtzfnJNyiTVxDd8ZkohODfM_PJPuiuGGPBJCQhV8viDIInLlx4HZwG7fZazgiBSskN2Rzlqb3FSqvWQxpQtokn3r672MLPNl2OPYpsGEHkyi94j_OeTl5vQOOC7HqD8QGBdbgly0SLP3XoT6BRFbflsgr4VW7pXm0 Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:58:12.471552 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:58:12.473153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/625652cfa47248faac8c1f7759c56a14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_625652cfa47248faac8c1f7759c56a14"}]}] Aug 24 17:58:12.473153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:12.473153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 625652cfa47248faac8c1f7759c56a14 Aug 24 17:58:12.473153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1955044063 Aug 24 17:58:12.473153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:12.473153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:58:12.473153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:58:12.473153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: d8b9d2b042c04927b9115085fcb4ba40 Aug 24 17:58:12.473153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-AttachVolumeNegativeTest-1955044063-project Aug 24 17:58:12.473153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:58:12.473153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:58:12.473153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '2e207e34-6199-4650-9358-5ef1fd30774a'} Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:12.474268 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. Aug 24 17:58:12.475806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:12.477259 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1e587dd3-27da-406a-b919-a530f8152db4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] Returning 404 to user: Instance 2e207e34-6199-4650-9358-5ef1fd30774a could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:12.477259 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1e587dd3-27da-406a-b919-a530f8152db4 tempest-AttachVolumeNegativeTest-1955044063 tempest-AttachVolumeNegativeTest-1955044063-project] 10.222.0.27 "GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a" status: 404 len: 111 microversion: 2.1 time: 0.031815 Aug 24 17:58:12.477259 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 501/976] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:12 2022] GET /compute/v2.1/servers/2e207e34-6199-4650-9358-5ef1fd30774a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:58:16.762412 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-00d17de0-eb92-4369-88eb-fdf8bd6e8135 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Action: 'create', calling method: .version_select at 0x7f4b2a1be430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-195924569"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:17.041126 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-00d17de0-eb92-4369-88eb-fdf8bd6e8135 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.394793 Aug 24 17:58:17.041830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 476/977] 10.222.0.27 () {60 vars in 1155 bytes} [Wed Aug 24 17:58:16 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 396 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 17:58:17.054260 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-fabda02a-43ac-416e-8779-23990705bfbb tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b297ba310>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:17.105894 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-fabda02a-43ac-416e-8779-23990705bfbb tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee" status: 200 len: 344 microversion: 2.1 time: 0.055596 Aug 24 17:58:17.106488 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 502/978] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:58:17 2022] GET /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:18.122821 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-e2eb091f-cab1-473f-8967-785dd1f0e1a4 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b2a2f74c0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:18.170154 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-e2eb091f-cab1-473f-8967-785dd1f0e1a4 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee" status: 200 len: 345 microversion: 2.1 time: 0.054383 Aug 24 17:58:18.170908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 477/979] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:58:18 2022] GET /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:18.183517 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-6255d21f-712e-4dfd-8f32-c15b7bfbac97 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Action: 'create', calling method: .version_select at 0x7f4b29766c10>, body: {"snapshot": {"volume_id": "48fbe291-862e-4bba-9017-dd50816ea1ee", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-398280645"}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:18.332462 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-6255d21f-712e-4dfd-8f32-c15b7bfbac97 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.153222 Aug 24 17:58:18.333135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 503/980] 10.222.0.27 () {60 vars in 1162 bytes} [Wed Aug 24 17:58:18 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:18.343938 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-be9bf751-f790-4a00-91c4-4f44852fabec tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b2960a8b0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:18.374412 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-be9bf751-f790-4a00-91c4-4f44852fabec tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5" status: 200 len: 286 microversion: 2.1 time: 0.034512 Aug 24 17:58:18.374986 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 478/981] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 17:58:18 2022] GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:18.386355 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-bf6a7bdd-7831-47c7-8867-40ae7c030c29 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b2968ad30>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:18.416979 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-bf6a7bdd-7831-47c7-8867-40ae7c030c29 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034950 Aug 24 17:58:18.417556 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 504/982] 10.222.0.27 () {58 vars in 1140 bytes} [Wed Aug 24 17:58:18 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:18.428743 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-77139d21-6406-405d-8160-5b7cdd34f155 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b2a129700>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:18.468491 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-77139d21-6406-405d-8160-5b7cdd34f155 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5" status: 200 len: 286 microversion: 2.1 time: 0.043547 Aug 24 17:58:18.469279 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 479/983] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 17:58:18 2022] GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:19.482229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3928f712-2827-42cf-a408-85eef0c56890 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b297ba550>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:19.511911 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3928f712-2827-42cf-a408-85eef0c56890 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5" status: 200 len: 286 microversion: 2.1 time: 0.033968 Aug 24 17:58:19.512452 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 505/984] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 17:58:19 2022] GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:20.524594 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-60486fda-b696-4450-8931-7c3a42087784 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b2a2ff0d0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:20.553069 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-60486fda-b696-4450-8931-7c3a42087784 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5" status: 200 len: 286 microversion: 2.1 time: 0.032792 Aug 24 17:58:20.553629 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 480/985] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 17:58:20 2022] GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:21.566471 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-100bc025-392c-4f63-8752-8087d3a70d44 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b29826940>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:21.598675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-100bc025-392c-4f63-8752-8087d3a70d44 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5" status: 200 len: 286 microversion: 2.1 time: 0.036429 Aug 24 17:58:21.599233 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 506/986] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 17:58:21 2022] GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:22.010131 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-528bc7b5-af96-4470-b5f6-22124e01f45b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:22.010658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-528bc7b5-af96-4470-b5f6-22124e01f45b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:22.011265 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-4902b710-4350-4c50-8a16-dd6a7cd8b609 req-284aef42-cf09-4449-b2df-51e3a15f34c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c6c085-c660-42cf-90ce-069f9ecfc17d", "tag": "206a6ecc-a9ba-4d78-b340-8f29b89a766a"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:22.019566 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-528bc7b5-af96-4470-b5f6-22124e01f45b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:22.020144 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-528bc7b5-af96-4470-b5f6-22124e01f45b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:22.020654 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-528bc7b5-af96-4470-b5f6-22124e01f45b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:22.021209 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-4902b710-4350-4c50-8a16-dd6a7cd8b609 req-284aef42-cf09-4449-b2df-51e3a15f34c8 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:22.021698 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-4902b710-4350-4c50-8a16-dd6a7cd8b609 req-284aef42-cf09-4449-b2df-51e3a15f34c8 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:22.022130 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-4902b710-4350-4c50-8a16-dd6a7cd8b609 req-284aef42-cf09-4449-b2df-51e3a15f34c8 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:22.022256 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-528bc7b5-af96-4470-b5f6-22124e01f45b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:22.022809 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-528bc7b5-af96-4470-b5f6-22124e01f45b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:22.023854 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-528bc7b5-af96-4470-b5f6-22124e01f45b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:22.029033 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:22.033519 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-4902b710-4350-4c50-8a16-dd6a7cd8b609 req-284aef42-cf09-4449-b2df-51e3a15f34c8 service nova] Creating event network-changed:206a6ecc-a9ba-4d78-b340-8f29b89a766a for instance 97c6c085-c660-42cf-90ce-069f9ecfc17d on hv-cinder-84052 Aug 24 17:58:22.038719 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-4902b710-4350-4c50-8a16-dd6a7cd8b609 req-284aef42-cf09-4449-b2df-51e3a15f34c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031046 Aug 24 17:58:22.039914 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 507/987] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:22.053956 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-528bc7b5-af96-4470-b5f6-22124e01f45b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:58:22.158105 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-528bc7b5-af96-4470-b5f6-22124e01f45b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "DELETE /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 204 len: 0 microversion: 2.1 time: 0.151820 Aug 24 17:58:22.159159 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 481/988] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:58:22 2022] DELETE /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:58:22.169281 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5d2a216c-c7c1-4eb4-9ff9-748e3cfc05f1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:22.170002 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5d2a216c-c7c1-4eb4-9ff9-748e3cfc05f1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:22.176964 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5d2a216c-c7c1-4eb4-9ff9-748e3cfc05f1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:22.177753 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5d2a216c-c7c1-4eb4-9ff9-748e3cfc05f1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:22.178373 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5d2a216c-c7c1-4eb4-9ff9-748e3cfc05f1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:22.179277 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5d2a216c-c7c1-4eb4-9ff9-748e3cfc05f1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:22.179964 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5d2a216c-c7c1-4eb4-9ff9-748e3cfc05f1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:22.180435 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5d2a216c-c7c1-4eb4-9ff9-748e3cfc05f1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:22.322342 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-5d2a216c-c7c1-4eb4-9ff9-748e3cfc05f1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:22.329982 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5d2a216c-c7c1-4eb4-9ff9-748e3cfc05f1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1576 microversion: 2.1 time: 0.165840 Aug 24 17:58:22.330538 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 508/989] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:22 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:22.611742 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7df2daba-81cc-41b6-ac33-99d3ae9748fb tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b2a2ff280>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:22.644362 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7df2daba-81cc-41b6-ac33-99d3ae9748fb tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5" status: 200 len: 287 microversion: 2.1 time: 0.037008 Aug 24 17:58:22.645592 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 482/990] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 17:58:22 2022] GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:22.656318 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-cfb113ef-9ee7-4218-a006-8e96030880bd tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b2985bd30>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:22.718809 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-cfb113ef-9ee7-4218-a006-8e96030880bd tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5" status: 202 len: 0 microversion: 2.1 time: 0.066082 Aug 24 17:58:22.719436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 509/991] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Aug 24 17:58:22 2022] DELETE /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:58:22.728286 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-1390c7c0-7e79-427c-b9b1-909d3e09245e tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b2a39d5e0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:22.758492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-1390c7c0-7e79-427c-b9b1-909d3e09245e tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5" status: 200 len: 286 microversion: 2.1 time: 0.034750 Aug 24 17:58:22.759533 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 483/992] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 17:58:22 2022] GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:23.351587 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4f9ba263-a954-4cd0-acef-5719a2a2f3d1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:23.352115 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4f9ba263-a954-4cd0-acef-5719a2a2f3d1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:23.358152 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4f9ba263-a954-4cd0-acef-5719a2a2f3d1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:23.358634 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4f9ba263-a954-4cd0-acef-5719a2a2f3d1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:23.359095 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4f9ba263-a954-4cd0-acef-5719a2a2f3d1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:23.359806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4f9ba263-a954-4cd0-acef-5719a2a2f3d1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:23.360262 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4f9ba263-a954-4cd0-acef-5719a2a2f3d1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:23.360686 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4f9ba263-a954-4cd0-acef-5719a2a2f3d1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:23.489616 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4f9ba263-a954-4cd0-acef-5719a2a2f3d1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:23.498284 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4f9ba263-a954-4cd0-acef-5719a2a2f3d1 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1576 microversion: 2.1 time: 0.150761 Aug 24 17:58:23.498837 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 510/993] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:23 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:23.771719 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-edb4172d-ab7a-4885-ac2b-2b14ea65b6cb tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b2a1791f0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:23.798087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-edb4172d-ab7a-4885-ac2b-2b14ea65b6cb tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] HTTP exception thrown: Snapshot dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 could not be found. Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-edb4172d-ab7a-4885-ac2b-2b14ea65b6cb tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Request method failure captured: Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 HTTP/1.1 Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBma4yTnuv4XHEeBOJtYXwc7w36TFnqDLFaJTn5Csegi1O47Fl_kc7CwO6Ncw0aKQeuEtfHwtMt9oVCnXoD103u-wTVsl45UiTTHWdnjxzVPpAQaDE3BbdW1-3kMLRP_hLs4y9aoIFniN9oKadHpWOCNkLhdgQ8nFP9pKKTiCYvorlms Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: c3f39580ab584e8ab9aa3a4d9e86d5d9 Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1675397068 Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:58:23.800520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}] Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1675397068 Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: c3f39580ab584e8ab9aa3a4d9e86d5d9 Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1675397068 Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-VolumesSnapshotsTestJSON-1675397068-project Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 1183cb7ade7b4758b9e6a106b7980355 Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1675397068-project Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Snapshot dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 could not be found. Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': 'dfb4636a-aee2-4d4c-a5a2-7749d4e563a5'} Aug 24 17:58:23.802245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 could not be found. (HTTP 404) (Request-ID: req-3f86dd1e-98ee-4a01-935d-c6ea06c198ab) Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:23.803427 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:58:23.805003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 could not be found. Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 17:58:23.807230 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 could not be found. Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 could not be found. Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-edb4172d-ab7a-4885-ac2b-2b14ea65b6cb tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Returning 404 to user: Snapshot dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:23.808826 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-edb4172d-ab7a-4885-ac2b-2b14ea65b6cb tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5" status: 404 len: 111 microversion: 2.1 time: 0.034540 Aug 24 17:58:23.809838 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 484/994] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Aug 24 17:58:23 2022] GET /compute/v2.1/os-snapshots/dfb4636a-aee2-4d4c-a5a2-7749d4e563a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:23.813874 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ecb0abc1-0f2c-4e02-914a-620a54b5e620 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b29732b80>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:23.879878 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ecb0abc1-0f2c-4e02-914a-620a54b5e620 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee" status: 202 len: 0 microversion: 2.1 time: 0.072625 Aug 24 17:58:23.880447 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 511/995] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 17:58:23 2022] DELETE /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 17:58:23.889835 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a7f7f141-b107-43f2-bf9e-93827cfa977d tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b2a2ff280>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:23.941836 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a7f7f141-b107-43f2-bf9e-93827cfa977d tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee" status: 200 len: 344 microversion: 2.1 time: 0.056454 Aug 24 17:58:23.942540 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 485/996] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:58:23 2022] GET /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:24.319556 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-5b0ba935-62cf-4c6d-b6e0-74a533255fad req-7cd46cab-4779-4365-bfe4-dbc623f5e927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c6c085-c660-42cf-90ce-069f9ecfc17d", "name": "network-vif-deleted", "tag": "206a6ecc-a9ba-4d78-b340-8f29b89a766a"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:24.330287 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-5b0ba935-62cf-4c6d-b6e0-74a533255fad req-7cd46cab-4779-4365-bfe4-dbc623f5e927 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:24.330770 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-5b0ba935-62cf-4c6d-b6e0-74a533255fad req-7cd46cab-4779-4365-bfe4-dbc623f5e927 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:24.331198 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-5b0ba935-62cf-4c6d-b6e0-74a533255fad req-7cd46cab-4779-4365-bfe4-dbc623f5e927 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:24.335119 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:24.342697 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-5b0ba935-62cf-4c6d-b6e0-74a533255fad req-7cd46cab-4779-4365-bfe4-dbc623f5e927 service nova] Creating event network-vif-deleted:206a6ecc-a9ba-4d78-b340-8f29b89a766a for instance 97c6c085-c660-42cf-90ce-069f9ecfc17d on hv-cinder-84052 Aug 24 17:58:24.347653 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-5b0ba935-62cf-4c6d-b6e0-74a533255fad req-7cd46cab-4779-4365-bfe4-dbc623f5e927 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032005 Aug 24 17:58:24.348242 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 512/997] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:24.527813 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9f46d86e-fbac-406d-a65d-83c036411c1d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:24.528622 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9f46d86e-fbac-406d-a65d-83c036411c1d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:24.531109 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:24.539504 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9f46d86e-fbac-406d-a65d-83c036411c1d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:24.540404 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9f46d86e-fbac-406d-a65d-83c036411c1d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:24.540846 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9f46d86e-fbac-406d-a65d-83c036411c1d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:24.541554 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9f46d86e-fbac-406d-a65d-83c036411c1d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:24.542010 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9f46d86e-fbac-406d-a65d-83c036411c1d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:24.542465 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9f46d86e-fbac-406d-a65d-83c036411c1d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:24.612967 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9f46d86e-fbac-406d-a65d-83c036411c1d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:24.623303 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9f46d86e-fbac-406d-a65d-83c036411c1d tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 200 len: 1225 microversion: 2.1 time: 0.100032 Aug 24 17:58:24.624104 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 486/998] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:24 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:24.957487 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9bfd0226-410e-48b5-b163-471b00a3c3f8 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b297320d0>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:24.990402 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-9bfd0226-410e-48b5-b163-471b00a3c3f8 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] HTTP exception thrown: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9bfd0226-410e-48b5-b163-471b00a3c3f8 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Request method failure captured: Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee HTTP/1.1 Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBma4yTnuv4XHEeBOJtYXwc7w36TFnqDLFaJTn5Csegi1O47Fl_kc7CwO6Ncw0aKQeuEtfHwtMt9oVCnXoD103u-wTVsl45UiTTHWdnjxzVPpAQaDE3BbdW1-3kMLRP_hLs4y9aoIFniN9oKadHpWOCNkLhdgQ8nFP9pKKTiCYvorlms Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: c3f39580ab584e8ab9aa3a4d9e86d5d9 Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1675397068 Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:58:24.993547 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}] Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1675397068 Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: c3f39580ab584e8ab9aa3a4d9e86d5d9 Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1675397068 Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-VolumesSnapshotsTestJSON-1675397068-project Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 1183cb7ade7b4758b9e6a106b7980355 Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1675397068-project Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '48fbe291-862e-4bba-9017-dd50816ea1ee'} Aug 24 17:58:24.995578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. (HTTP 404) (Request-ID: req-a14e62c9-a89a-4299-b76c-173b5405d989) Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:24.996640 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:58:24.997832 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:58:24.999020 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9bfd0226-410e-48b5-b163-471b00a3c3f8 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Returning 404 to user: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9bfd0226-410e-48b5-b163-471b00a3c3f8 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee" status: 404 len: 109 microversion: 2.1 time: 0.042199 Aug 24 17:58:25.000254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 513/999] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:58:24 2022] GET /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:58:25.012575 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b7e0465d-7696-4a80-9166-b490fd72db17 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b2a2ff5e0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:25.040368 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-b7e0465d-7696-4a80-9166-b490fd72db17 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] HTTP exception thrown: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b7e0465d-7696-4a80-9166-b490fd72db17 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Request method failure captured: Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: DELETE /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee HTTP/1.1 Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBma4yTnuv4XHEeBOJtYXwc7w36TFnqDLFaJTn5Csegi1O47Fl_kc7CwO6Ncw0aKQeuEtfHwtMt9oVCnXoD103u-wTVsl45UiTTHWdnjxzVPpAQaDE3BbdW1-3kMLRP_hLs4y9aoIFniN9oKadHpWOCNkLhdgQ8nFP9pKKTiCYvorlms Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: c3f39580ab584e8ab9aa3a4d9e86d5d9 Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1675397068 Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:58:25.042410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}] Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1675397068 Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: c3f39580ab584e8ab9aa3a4d9e86d5d9 Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1675397068 Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-VolumesSnapshotsTestJSON-1675397068-project Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 1183cb7ade7b4758b9e6a106b7980355 Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1675397068-project Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '48fbe291-862e-4bba-9017-dd50816ea1ee'} Aug 24 17:58:25.044049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. (HTTP 404) (Request-ID: req-b365bff6-5769-4936-b5d0-c9986544ff70) Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:25.045059 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 17:58:25.046301 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 17:58:25.047519 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b7e0465d-7696-4a80-9166-b490fd72db17 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Returning 404 to user: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:25.048849 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b7e0465d-7696-4a80-9166-b490fd72db17 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee" status: 404 len: 109 microversion: 2.1 time: 0.035922 Aug 24 17:58:25.049997 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 487/1000] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 17:58:25 2022] DELETE /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:58:25.052802 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-df547d43-03fd-44cf-8b8d-fddd1d98d0f4 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Calling method '.version_select at 0x7f4b297d51f0>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:25.083275 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-df547d43-03fd-44cf-8b8d-fddd1d98d0f4 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] HTTP exception thrown: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-df547d43-03fd-44cf-8b8d-fddd1d98d0f4 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Request method failure captured: Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee HTTP/1.1 Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBma4yTnuv4XHEeBOJtYXwc7w36TFnqDLFaJTn5Csegi1O47Fl_kc7CwO6Ncw0aKQeuEtfHwtMt9oVCnXoD103u-wTVsl45UiTTHWdnjxzVPpAQaDE3BbdW1-3kMLRP_hLs4y9aoIFniN9oKadHpWOCNkLhdgQ8nFP9pKKTiCYvorlms Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: c3f39580ab584e8ab9aa3a4d9e86d5d9 Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1675397068 Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:58:25.085249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c3f39580ab584e8ab9aa3a4d9e86d5d9"}]}] Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1675397068 Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: c3f39580ab584e8ab9aa3a4d9e86d5d9 Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1675397068 Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-VolumesSnapshotsTestJSON-1675397068-project Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 1183cb7ade7b4758b9e6a106b7980355 Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1675397068-project Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '48fbe291-862e-4bba-9017-dd50816ea1ee'} Aug 24 17:58:25.086888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. (HTTP 404) (Request-ID: req-83ab6306-73b4-4fc5-be83-5608d2fd5a83) Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:25.088072 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 17:58:25.089551 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 17:58:25.091190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-df547d43-03fd-44cf-8b8d-fddd1d98d0f4 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] Returning 404 to user: Volume 48fbe291-862e-4bba-9017-dd50816ea1ee could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-df547d43-03fd-44cf-8b8d-fddd1d98d0f4 tempest-VolumesSnapshotsTestJSON-1675397068 tempest-VolumesSnapshotsTestJSON-1675397068-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee" status: 404 len: 109 microversion: 2.1 time: 0.037772 Aug 24 17:58:25.092755 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 514/1001] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Aug 24 17:58:25 2022] GET /compute/v2.1/os-volumes/48fbe291-862e-4bba-9017-dd50816ea1ee => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:25.644843 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0ef39433-2fd9-4780-9473-d167d07d80f7 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:25.645577 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-0ef39433-2fd9-4780-9473-d167d07d80f7 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 97c6c085-c660-42cf-90ce-069f9ecfc17d] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:25.652968 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ef39433-2fd9-4780-9473-d167d07d80f7 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:25.653456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ef39433-2fd9-4780-9473-d167d07d80f7 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:25.653890 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ef39433-2fd9-4780-9473-d167d07d80f7 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:25.654590 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ef39433-2fd9-4780-9473-d167d07d80f7 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:25.655045 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ef39433-2fd9-4780-9473-d167d07d80f7 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:25.655470 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-0ef39433-2fd9-4780-9473-d167d07d80f7 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:25.669204 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-0ef39433-2fd9-4780-9473-d167d07d80f7 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] HTTP exception thrown: Instance 97c6c085-c660-42cf-90ce-069f9ecfc17d could not be found. Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0ef39433-2fd9-4780-9473-d167d07d80f7 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Request method failure captured: Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d HTTP/1.1 Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmUBWkfrS8ZGkmyQEOGi6Laer1EmDuN36spPyhpJLIaExnRNcpyr9WwfeQ_2ljIiYQnap_XPjj-n_0rVdH6C-CVYneD-6jeB7hEDt4A8XyL6P_x0LTfOYUQmKjNApcsoBIPsipNHs5DdFHSTa6DFNh1m3J8Koy9sTSNziiox3P8Suo4 Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: b9cd3cd0a9434f5ab0e1e1c52145beb2 Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-TestVolumeBootPattern-298645184 Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:58:25.670677 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:58:25.672327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}] Aug 24 17:58:25.672327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-TestVolumeBootPattern-298645184 Aug 24 17:58:25.672327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: b9cd3cd0a9434f5ab0e1e1c52145beb2 Aug 24 17:58:25.672327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-TestVolumeBootPattern-298645184 Aug 24 17:58:25.672327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-TestVolumeBootPattern-298645184-project Aug 24 17:58:25.672327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:58:25.672327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:58:25.672327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 4279761de1464be38860432a46a89074 Aug 24 17:58:25.672327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-TestVolumeBootPattern-298645184-project Aug 24 17:58:25.672327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:58:25.672327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 97c6c085-c660-42cf-90ce-069f9ecfc17d could not be found. Aug 24 17:58:25.672327 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '97c6c085-c660-42cf-90ce-069f9ecfc17d'} Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97c6c085-c660-42cf-90ce-069f9ecfc17d could not be found. Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:25.673167 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97c6c085-c660-42cf-90ce-069f9ecfc17d could not be found. Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97c6c085-c660-42cf-90ce-069f9ecfc17d could not be found. Aug 24 17:58:25.674658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:25.676111 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-0ef39433-2fd9-4780-9473-d167d07d80f7 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Returning 404 to user: Instance 97c6c085-c660-42cf-90ce-069f9ecfc17d could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:25.676111 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-0ef39433-2fd9-4780-9473-d167d07d80f7 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d" status: 404 len: 111 microversion: 2.1 time: 0.031261 Aug 24 17:58:25.676111 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 488/1002] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:25 2022] GET /compute/v2.1/servers/97c6c085-c660-42cf-90ce-069f9ecfc17d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:29.016979 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a13bbb6f-0bed-4523-87af-3b8a3febf1a2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:29.017660 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a13bbb6f-0bed-4523-87af-3b8a3febf1a2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:29.020337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:29.027387 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a13bbb6f-0bed-4523-87af-3b8a3febf1a2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:29.028033 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a13bbb6f-0bed-4523-87af-3b8a3febf1a2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:29.028538 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a13bbb6f-0bed-4523-87af-3b8a3febf1a2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:29.029313 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a13bbb6f-0bed-4523-87af-3b8a3febf1a2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:29.030019 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a13bbb6f-0bed-4523-87af-3b8a3febf1a2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:29.030565 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a13bbb6f-0bed-4523-87af-3b8a3febf1a2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:29.058621 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a13bbb6f-0bed-4523-87af-3b8a3febf1a2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Going to try to terminate instance {{(pid=126994) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:58:29.140433 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a13bbb6f-0bed-4523-87af-3b8a3febf1a2 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "DELETE /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 204 len: 0 microversion: 2.1 time: 0.127940 Aug 24 17:58:29.141757 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 515/1003] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:58:29 2022] DELETE /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:58:29.152135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-50b8adea-d9f8-4455-84d9-46e72a141a8b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:29.152847 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-50b8adea-d9f8-4455-84d9-46e72a141a8b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:29.158796 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-50b8adea-d9f8-4455-84d9-46e72a141a8b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:29.159499 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-50b8adea-d9f8-4455-84d9-46e72a141a8b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:29.159950 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-50b8adea-d9f8-4455-84d9-46e72a141a8b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:29.160655 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-50b8adea-d9f8-4455-84d9-46e72a141a8b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:29.161115 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-50b8adea-d9f8-4455-84d9-46e72a141a8b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:29.161538 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-50b8adea-d9f8-4455-84d9-46e72a141a8b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:29.168509 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-4925600a-ea7b-49cd-b492-6d562f81eabd req-1ecafa70-1a7e-41cf-baad-6dde19da3fcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38237468-6ade-46a7-830f-371a8a34c4f4", "tag": "68a6e936-3e2e-4bc2-ab59-de0b96e000d7"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:29.178211 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-4925600a-ea7b-49cd-b492-6d562f81eabd req-1ecafa70-1a7e-41cf-baad-6dde19da3fcf service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:29.178798 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-4925600a-ea7b-49cd-b492-6d562f81eabd req-1ecafa70-1a7e-41cf-baad-6dde19da3fcf service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:29.179504 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-4925600a-ea7b-49cd-b492-6d562f81eabd req-1ecafa70-1a7e-41cf-baad-6dde19da3fcf service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:29.191155 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-4925600a-ea7b-49cd-b492-6d562f81eabd req-1ecafa70-1a7e-41cf-baad-6dde19da3fcf service nova] Creating event network-changed:68a6e936-3e2e-4bc2-ab59-de0b96e000d7 for instance 38237468-6ade-46a7-830f-371a8a34c4f4 on hv-cinder-84052 Aug 24 17:58:29.198658 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-4925600a-ea7b-49cd-b492-6d562f81eabd req-1ecafa70-1a7e-41cf-baad-6dde19da3fcf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183613 Aug 24 17:58:29.199846 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 489/1004] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:58:29.301377 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-50b8adea-d9f8-4455-84d9-46e72a141a8b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:29.309613 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-50b8adea-d9f8-4455-84d9-46e72a141a8b tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1577 microversion: 2.1 time: 0.162390 Aug 24 17:58:29.310197 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 516/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:29 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:30.333760 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7a70532e-6b4f-49d7-9823-948370d0be54 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:30.334464 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7a70532e-6b4f-49d7-9823-948370d0be54 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:30.341005 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7a70532e-6b4f-49d7-9823-948370d0be54 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:30.341495 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7a70532e-6b4f-49d7-9823-948370d0be54 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:30.341928 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7a70532e-6b4f-49d7-9823-948370d0be54 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:30.342619 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7a70532e-6b4f-49d7-9823-948370d0be54 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:30.343072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7a70532e-6b4f-49d7-9823-948370d0be54 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:30.343511 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7a70532e-6b4f-49d7-9823-948370d0be54 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:30.474469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7a70532e-6b4f-49d7-9823-948370d0be54 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:30.482477 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7a70532e-6b4f-49d7-9823-948370d0be54 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1577 microversion: 2.1 time: 0.153393 Aug 24 17:58:30.483044 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 490/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:30 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:31.511408 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-50cb11c3-c58b-4b56-bc75-3906a18d7984 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:31.511974 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-50cb11c3-c58b-4b56-bc75-3906a18d7984 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:31.518428 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-50cb11c3-c58b-4b56-bc75-3906a18d7984 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:31.518915 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-50cb11c3-c58b-4b56-bc75-3906a18d7984 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:31.519353 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-50cb11c3-c58b-4b56-bc75-3906a18d7984 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:31.520077 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-50cb11c3-c58b-4b56-bc75-3906a18d7984 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:31.520534 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-50cb11c3-c58b-4b56-bc75-3906a18d7984 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:31.520959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-50cb11c3-c58b-4b56-bc75-3906a18d7984 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:31.654231 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-50cb11c3-c58b-4b56-bc75-3906a18d7984 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:31.661924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-50cb11c3-c58b-4b56-bc75-3906a18d7984 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1577 microversion: 2.1 time: 0.154995 Aug 24 17:58:31.662485 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 517/1007] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:31 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:32.682742 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-3ec1c037-faf3-44f3-b35d-315d366a0203 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:32.683391 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-3ec1c037-faf3-44f3-b35d-315d366a0203 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:32.689995 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ec1c037-faf3-44f3-b35d-315d366a0203 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:32.690489 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ec1c037-faf3-44f3-b35d-315d366a0203 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:32.690929 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ec1c037-faf3-44f3-b35d-315d366a0203 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:32.691653 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ec1c037-faf3-44f3-b35d-315d366a0203 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:32.692146 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ec1c037-faf3-44f3-b35d-315d366a0203 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:32.692572 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-3ec1c037-faf3-44f3-b35d-315d366a0203 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:32.829398 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-3ec1c037-faf3-44f3-b35d-315d366a0203 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:32.837214 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-3ec1c037-faf3-44f3-b35d-315d366a0203 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1577 microversion: 2.1 time: 0.158906 Aug 24 17:58:32.837814 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 491/1008] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:32 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:33.694996 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-1ac3628b-86b8-462d-9b77-ed0008560aa9 req-9e806cd5-8657-44e1-9826-5c4b411ff0ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38237468-6ade-46a7-830f-371a8a34c4f4", "name": "network-vif-deleted", "tag": "68a6e936-3e2e-4bc2-ab59-de0b96e000d7"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:33.705318 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-1ac3628b-86b8-462d-9b77-ed0008560aa9 req-9e806cd5-8657-44e1-9826-5c4b411ff0ff service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:33.705791 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-1ac3628b-86b8-462d-9b77-ed0008560aa9 req-9e806cd5-8657-44e1-9826-5c4b411ff0ff service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:33.706216 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-1ac3628b-86b8-462d-9b77-ed0008560aa9 req-9e806cd5-8657-44e1-9826-5c4b411ff0ff service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:33.717703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-1ac3628b-86b8-462d-9b77-ed0008560aa9 req-9e806cd5-8657-44e1-9826-5c4b411ff0ff service nova] Creating event network-vif-deleted:68a6e936-3e2e-4bc2-ab59-de0b96e000d7 for instance 38237468-6ade-46a7-830f-371a8a34c4f4 on hv-cinder-84052 Aug 24 17:58:33.722623 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-1ac3628b-86b8-462d-9b77-ed0008560aa9 req-9e806cd5-8657-44e1-9826-5c4b411ff0ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032099 Aug 24 17:58:33.723255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 518/1009] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:33.859385 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-fe2ba54c-6db8-4410-aeb8-e6bd8b8144ee tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:33.860129 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-fe2ba54c-6db8-4410-aeb8-e6bd8b8144ee tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:33.866459 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fe2ba54c-6db8-4410-aeb8-e6bd8b8144ee tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:33.866950 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fe2ba54c-6db8-4410-aeb8-e6bd8b8144ee tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:33.867415 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fe2ba54c-6db8-4410-aeb8-e6bd8b8144ee tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:33.868140 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fe2ba54c-6db8-4410-aeb8-e6bd8b8144ee tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:33.868595 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fe2ba54c-6db8-4410-aeb8-e6bd8b8144ee tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:33.869060 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fe2ba54c-6db8-4410-aeb8-e6bd8b8144ee tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:33.931537 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-fe2ba54c-6db8-4410-aeb8-e6bd8b8144ee tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4279761de1464be38860432a46a89074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9cd3cd0a9434f5ab0e1e1c52145beb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:33.939355 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-fe2ba54c-6db8-4410-aeb8-e6bd8b8144ee tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 200 len: 1226 microversion: 2.1 time: 0.083764 Aug 24 17:58:33.940223 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 492/1010] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:33 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:34.962081 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ab70dadd-c3b0-4475-a9b7-b854434ae6d9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:34.962780 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ab70dadd-c3b0-4475-a9b7-b854434ae6d9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 38237468-6ade-46a7-830f-371a8a34c4f4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:34.968813 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ab70dadd-c3b0-4475-a9b7-b854434ae6d9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:34.969300 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ab70dadd-c3b0-4475-a9b7-b854434ae6d9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:34.969731 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ab70dadd-c3b0-4475-a9b7-b854434ae6d9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:34.970419 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ab70dadd-c3b0-4475-a9b7-b854434ae6d9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:34.970872 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ab70dadd-c3b0-4475-a9b7-b854434ae6d9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:34.971296 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ab70dadd-c3b0-4475-a9b7-b854434ae6d9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:34.985856 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-ab70dadd-c3b0-4475-a9b7-b854434ae6d9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] HTTP exception thrown: Instance 38237468-6ade-46a7-830f-371a8a34c4f4 could not be found. Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ab70dadd-c3b0-4475-a9b7-b854434ae6d9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Request method failure captured: Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 HTTP/1.1 Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmUBWkfrS8ZGkmyQEOGi6Laer1EmDuN36spPyhpJLIaExnRNcpyr9WwfeQ_2ljIiYQnap_XPjj-n_0rVdH6C-CVYneD-6jeB7hEDt4A8XyL6P_x0LTfOYUQmKjNApcsoBIPsipNHs5DdFHSTa6DFNh1m3J8Koy9sTSNziiox3P8Suo4 Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: b9cd3cd0a9434f5ab0e1e1c52145beb2 Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-TestVolumeBootPattern-298645184 Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:58:34.987905 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:58:34.989604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}] Aug 24 17:58:34.989604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-TestVolumeBootPattern-298645184 Aug 24 17:58:34.989604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: b9cd3cd0a9434f5ab0e1e1c52145beb2 Aug 24 17:58:34.989604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-TestVolumeBootPattern-298645184 Aug 24 17:58:34.989604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-TestVolumeBootPattern-298645184-project Aug 24 17:58:34.989604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:58:34.989604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:58:34.989604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 4279761de1464be38860432a46a89074 Aug 24 17:58:34.989604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-TestVolumeBootPattern-298645184-project Aug 24 17:58:34.989604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:58:34.989604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 38237468-6ade-46a7-830f-371a8a34c4f4 could not be found. Aug 24 17:58:34.989604 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '38237468-6ade-46a7-830f-371a8a34c4f4'} Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38237468-6ade-46a7-830f-371a8a34c4f4 could not be found. Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:34.990533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38237468-6ade-46a7-830f-371a8a34c4f4 could not be found. Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38237468-6ade-46a7-830f-371a8a34c4f4 could not be found. Aug 24 17:58:34.992132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:34.993554 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ab70dadd-c3b0-4475-a9b7-b854434ae6d9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Returning 404 to user: Instance 38237468-6ade-46a7-830f-371a8a34c4f4 could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:34.993554 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ab70dadd-c3b0-4475-a9b7-b854434ae6d9 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4" status: 404 len: 111 microversion: 2.1 time: 0.031847 Aug 24 17:58:34.993554 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 519/1011] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:34 2022] GET /compute/v2.1/servers/38237468-6ade-46a7-830f-371a8a34c4f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:35.436429 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c7b2b6a8-3075-499e-b1d0-1ac40b3f2bdb tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:35.436956 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c7b2b6a8-3075-499e-b1d0-1ac40b3f2bdb tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:35.443620 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c7b2b6a8-3075-499e-b1d0-1ac40b3f2bdb tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:35.444103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c7b2b6a8-3075-499e-b1d0-1ac40b3f2bdb tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:35.444534 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c7b2b6a8-3075-499e-b1d0-1ac40b3f2bdb tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:35.445221 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c7b2b6a8-3075-499e-b1d0-1ac40b3f2bdb tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:35.445675 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c7b2b6a8-3075-499e-b1d0-1ac40b3f2bdb tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:35.446100 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c7b2b6a8-3075-499e-b1d0-1ac40b3f2bdb tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:35.460099 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-c7b2b6a8-3075-499e-b1d0-1ac40b3f2bdb tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] HTTP exception thrown: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c7b2b6a8-3075-499e-b1d0-1ac40b3f2bdb tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Request method failure captured: Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: DELETE /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 HTTP/1.1 Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmUBWkfrS8ZGkmyQEOGi6Laer1EmDuN36spPyhpJLIaExnRNcpyr9WwfeQ_2ljIiYQnap_XPjj-n_0rVdH6C-CVYneD-6jeB7hEDt4A8XyL6P_x0LTfOYUQmKjNApcsoBIPsipNHs5DdFHSTa6DFNh1m3J8Koy9sTSNziiox3P8Suo4 Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: b9cd3cd0a9434f5ab0e1e1c52145beb2 Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-TestVolumeBootPattern-298645184 Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:58:35.461733 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:58:35.463347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}] Aug 24 17:58:35.463347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-TestVolumeBootPattern-298645184 Aug 24 17:58:35.463347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: b9cd3cd0a9434f5ab0e1e1c52145beb2 Aug 24 17:58:35.463347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-TestVolumeBootPattern-298645184 Aug 24 17:58:35.463347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-TestVolumeBootPattern-298645184-project Aug 24 17:58:35.463347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:58:35.463347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:58:35.463347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 4279761de1464be38860432a46a89074 Aug 24 17:58:35.463347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-TestVolumeBootPattern-298645184-project Aug 24 17:58:35.463347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:58:35.463347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:58:35.463347 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '33b47b8e-315b-4035-b274-e3d90094cea0'} Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:35.464246 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:58:35.465492 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:58:35.466753 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c7b2b6a8-3075-499e-b1d0-1ac40b3f2bdb tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Returning 404 to user: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:35.466753 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c7b2b6a8-3075-499e-b1d0-1ac40b3f2bdb tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "DELETE /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 404 len: 111 microversion: 2.1 time: 0.030616 Aug 24 17:58:35.466753 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 493/1012] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:58:35 2022] DELETE /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:35.471928 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d368dd1e-2002-425a-802e-1b7e4ba486e3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:35.472540 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-d368dd1e-2002-425a-802e-1b7e4ba486e3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] [instance: 33b47b8e-315b-4035-b274-e3d90094cea0] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:35.478322 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d368dd1e-2002-425a-802e-1b7e4ba486e3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:35.478799 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d368dd1e-2002-425a-802e-1b7e4ba486e3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:35.479253 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d368dd1e-2002-425a-802e-1b7e4ba486e3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:35.479962 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d368dd1e-2002-425a-802e-1b7e4ba486e3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:35.480413 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d368dd1e-2002-425a-802e-1b7e4ba486e3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:35.480864 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-d368dd1e-2002-425a-802e-1b7e4ba486e3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:35.493811 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-d368dd1e-2002-425a-802e-1b7e4ba486e3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] HTTP exception thrown: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d368dd1e-2002-425a-802e-1b7e4ba486e3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Request method failure captured: Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 HTTP/1.1 Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmUBWkfrS8ZGkmyQEOGi6Laer1EmDuN36spPyhpJLIaExnRNcpyr9WwfeQ_2ljIiYQnap_XPjj-n_0rVdH6C-CVYneD-6jeB7hEDt4A8XyL6P_x0LTfOYUQmKjNApcsoBIPsipNHs5DdFHSTa6DFNh1m3J8Koy9sTSNziiox3P8Suo4 Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: b9cd3cd0a9434f5ab0e1e1c52145beb2 Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-TestVolumeBootPattern-298645184 Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:58:35.495880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:58:35.497558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9cd3cd0a9434f5ab0e1e1c52145beb2"}]}] Aug 24 17:58:35.497558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-TestVolumeBootPattern-298645184 Aug 24 17:58:35.497558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: b9cd3cd0a9434f5ab0e1e1c52145beb2 Aug 24 17:58:35.497558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-TestVolumeBootPattern-298645184 Aug 24 17:58:35.497558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-TestVolumeBootPattern-298645184-project Aug 24 17:58:35.497558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:58:35.497558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:58:35.497558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 4279761de1464be38860432a46a89074 Aug 24 17:58:35.497558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-TestVolumeBootPattern-298645184-project Aug 24 17:58:35.497558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:58:35.497558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:58:35.497558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '33b47b8e-315b-4035-b274-e3d90094cea0'} Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:35.498641 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. Aug 24 17:58:35.500182 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:35.501628 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-d368dd1e-2002-425a-802e-1b7e4ba486e3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Returning 404 to user: Instance 33b47b8e-315b-4035-b274-e3d90094cea0 could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:35.501628 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-d368dd1e-2002-425a-802e-1b7e4ba486e3 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0" status: 404 len: 111 microversion: 2.1 time: 0.029313 Aug 24 17:58:35.501628 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 520/1013] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:35 2022] GET /compute/v2.1/servers/33b47b8e-315b-4035-b274-e3d90094cea0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:36.815318 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7784bb22-e188-48ff-a043-a89368e45a11 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] Calling method '.version_select at 0x7f4b2a18baf0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:36.840499 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7784bb22-e188-48ff-a043-a89368e45a11 tempest-TestVolumeBootPattern-298645184 tempest-TestVolumeBootPattern-298645184-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1899728589" status: 202 len: 0 microversion: 2.1 time: 0.028847 Aug 24 17:58:36.841082 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 494/1014] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Aug 24 17:58:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1899728589 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:58:40.388632 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1a79c23c-a3f6-4877-8c6c-4302d5b21df3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:40.391358 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1a79c23c-a3f6-4877-8c6c-4302d5b21df3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:40.403838 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1a79c23c-a3f6-4877-8c6c-4302d5b21df3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:40.404368 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1a79c23c-a3f6-4877-8c6c-4302d5b21df3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:40.404804 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1a79c23c-a3f6-4877-8c6c-4302d5b21df3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:40.405846 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1a79c23c-a3f6-4877-8c6c-4302d5b21df3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:40.406308 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1a79c23c-a3f6-4877-8c6c-4302d5b21df3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:40.406740 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1a79c23c-a3f6-4877-8c6c-4302d5b21df3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:40.438362 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1a79c23c-a3f6-4877-8c6c-4302d5b21df3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053933 Aug 24 17:58:40.438924 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 521/1015] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:58:40 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:58:40.505871 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ddc405c1-cdef-4810-9263-233fc98ca677 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:40.506464 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ddc405c1-cdef-4810-9263-233fc98ca677 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:40.513731 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ddc405c1-cdef-4810-9263-233fc98ca677 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:40.514223 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ddc405c1-cdef-4810-9263-233fc98ca677 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:40.514845 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ddc405c1-cdef-4810-9263-233fc98ca677 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:40.515584 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ddc405c1-cdef-4810-9263-233fc98ca677 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:40.516045 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ddc405c1-cdef-4810-9263-233fc98ca677 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:40.516464 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ddc405c1-cdef-4810-9263-233fc98ca677 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:40.543493 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ddc405c1-cdef-4810-9263-233fc98ca677 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:58:40.637747 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ddc405c1-cdef-4810-9263-233fc98ca677 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 204 len: 0 microversion: 2.1 time: 0.135777 Aug 24 17:58:40.638971 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 495/1016] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:58:40 2022] DELETE /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:58:40.647657 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-8afc0e0f-c076-4a7d-b084-64ca5b7d5d9d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:40.648313 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-8afc0e0f-c076-4a7d-b084-64ca5b7d5d9d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:40.658702 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8afc0e0f-c076-4a7d-b084-64ca5b7d5d9d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:40.659609 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8afc0e0f-c076-4a7d-b084-64ca5b7d5d9d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:40.660241 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8afc0e0f-c076-4a7d-b084-64ca5b7d5d9d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:40.661172 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8afc0e0f-c076-4a7d-b084-64ca5b7d5d9d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:40.661972 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8afc0e0f-c076-4a7d-b084-64ca5b7d5d9d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:40.662672 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-8afc0e0f-c076-4a7d-b084-64ca5b7d5d9d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:40.916888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-8afc0e0f-c076-4a7d-b084-64ca5b7d5d9d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:40.927743 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-8afc0e0f-c076-4a7d-b084-64ca5b7d5d9d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1675 microversion: 2.1 time: 0.284531 Aug 24 17:58:40.929308 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 522/1017] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:40 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1675 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:41.951309 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-7ff6c4c4-6121-4793-857c-285a4017cadc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:41.952541 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-7ff6c4c4-6121-4793-857c-285a4017cadc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:41.959550 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ff6c4c4-6121-4793-857c-285a4017cadc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:41.960257 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ff6c4c4-6121-4793-857c-285a4017cadc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:41.960691 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ff6c4c4-6121-4793-857c-285a4017cadc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:41.961382 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ff6c4c4-6121-4793-857c-285a4017cadc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:41.962003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ff6c4c4-6121-4793-857c-285a4017cadc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:41.963056 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-7ff6c4c4-6121-4793-857c-285a4017cadc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:42.117414 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-7ff6c4c4-6121-4793-857c-285a4017cadc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:42.130372 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-7ff6c4c4-6121-4793-857c-285a4017cadc tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1675 microversion: 2.1 time: 0.183733 Aug 24 17:58:42.131409 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 496/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:41 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:43.153987 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-66e8b4cf-1167-4814-a58f-c49c197fc265 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:43.155455 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-66e8b4cf-1167-4814-a58f-c49c197fc265 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:43.175161 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-66e8b4cf-1167-4814-a58f-c49c197fc265 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:43.175942 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-66e8b4cf-1167-4814-a58f-c49c197fc265 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:43.176593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-66e8b4cf-1167-4814-a58f-c49c197fc265 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:43.177478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-66e8b4cf-1167-4814-a58f-c49c197fc265 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:43.178088 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-66e8b4cf-1167-4814-a58f-c49c197fc265 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:43.178664 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-66e8b4cf-1167-4814-a58f-c49c197fc265 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:43.456851 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-66e8b4cf-1167-4814-a58f-c49c197fc265 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:43.465680 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-66e8b4cf-1167-4814-a58f-c49c197fc265 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 200 len: 1675 microversion: 2.1 time: 0.316666 Aug 24 17:58:43.466295 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 523/1019] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:43 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 1675 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:43.790000 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-f62fa8ea-2655-4e51-9178-b93326bf2193 req-b9de7a22-73df-4c91-8bb6-66fd67048260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbbd365-963e-4126-835c-d2a1725dfd77", "name": "network-vif-deleted", "tag": "1bd0f31f-109e-44d3-a9ca-645f8d269396"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:43.810897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-f62fa8ea-2655-4e51-9178-b93326bf2193 req-b9de7a22-73df-4c91-8bb6-66fd67048260 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:43.811611 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-f62fa8ea-2655-4e51-9178-b93326bf2193 req-b9de7a22-73df-4c91-8bb6-66fd67048260 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:43.811833 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-f62fa8ea-2655-4e51-9178-b93326bf2193 req-b9de7a22-73df-4c91-8bb6-66fd67048260 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:43.851830 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-f62fa8ea-2655-4e51-9178-b93326bf2193 req-b9de7a22-73df-4c91-8bb6-66fd67048260 service nova] Creating event network-vif-deleted:1bd0f31f-109e-44d3-a9ca-645f8d269396 for instance 1fbbd365-963e-4126-835c-d2a1725dfd77 on hv-cinder-84052 Aug 24 17:58:43.857803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-f62fa8ea-2655-4e51-9178-b93326bf2193 req-b9de7a22-73df-4c91-8bb6-66fd67048260 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071686 Aug 24 17:58:43.859019 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 497/1020] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:44.496357 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1143a360-576c-415d-9f9a-c81ce1ec5b6c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:44.498745 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1143a360-576c-415d-9f9a-c81ce1ec5b6c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:44.516012 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1143a360-576c-415d-9f9a-c81ce1ec5b6c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:44.516517 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1143a360-576c-415d-9f9a-c81ce1ec5b6c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:44.519082 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1143a360-576c-415d-9f9a-c81ce1ec5b6c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:44.519913 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1143a360-576c-415d-9f9a-c81ce1ec5b6c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:44.520385 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1143a360-576c-415d-9f9a-c81ce1ec5b6c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:44.522462 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1143a360-576c-415d-9f9a-c81ce1ec5b6c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:44.542946 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-1143a360-576c-415d-9f9a-c81ce1ec5b6c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] HTTP exception thrown: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1143a360-576c-415d-9f9a-c81ce1ec5b6c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Request method failure captured: Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 HTTP/1.1 Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmYhLpa-wCcqmk772WcGDCX6Jf6sEYrPUH455zY2sKe9op00ezw3NK8i3UkCxmICwXd5fQQTBxkheYvUc6PGLyoZNdKeGhqbB8d8a1HV55W-yihH1qXH6cY6dTh1UvQDBl0udhEmwzE0LAQoGVgaabYDo4QNJsBEFw7QtISazDZhmSk Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 1422bbfed9414b8cada1656aed195a31 Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-AttachVolumeTestJSON-902035080 Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 17:58:44.544593 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 17:58:44.546325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1422bbfed9414b8cada1656aed195a31"}]}] Aug 24 17:58:44.546325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-AttachVolumeTestJSON-902035080 Aug 24 17:58:44.546325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 1422bbfed9414b8cada1656aed195a31 Aug 24 17:58:44.546325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-902035080 Aug 24 17:58:44.546325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-AttachVolumeTestJSON-902035080-project Aug 24 17:58:44.546325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 17:58:44.546325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 17:58:44.546325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 1daca2cfac58487189f1fe8bf4bcb130 Aug 24 17:58:44.546325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-AttachVolumeTestJSON-902035080-project Aug 24 17:58:44.546325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 17:58:44.546325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 17:58:44.546325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '1fbbd365-963e-4126-835c-d2a1725dfd77'} Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:58:44.547675 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 17:58:44.549302 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 17:58:44.550748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1143a360-576c-415d-9f9a-c81ce1ec5b6c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Returning 404 to user: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:58:44.550748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1143a360-576c-415d-9f9a-c81ce1ec5b6c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 404 len: 111 microversion: 2.1 time: 0.061553 Aug 24 17:58:44.550748 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 524/1021] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:44 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:58:44.557995 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-597b9098-dd36-44b5-ab5f-02e0da4976d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '.version_select at 0x7f4b2a4c18b0>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:44.586281 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-597b9098-dd36-44b5-ab5f-02e0da4976d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219266933" status: 202 len: 0 microversion: 2.1 time: 0.032712 Aug 24 17:58:44.589606 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 498/1022] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 24 17:58:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219266933 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:58:45.389241 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9969f840-d799-4c4d-8f06-16e26d16580d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Action: 'create', calling method: .version_select at 0x7f4b29878550>, body: {"keypair": {"name": "tempest-keypair-1214763961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzbt8pYGjhUCwNNhKEof8KomzsG0O4+LAdtIEjfLV5bVxY8evAvK1tunlF+MSKgDTuBHp6AU2GIztsIYkS8WcAZuSX2Prb2vFH7kO/TTeT/APF1UqVI8Ha9XHnitu1plQ=="}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:45.410620 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-9969f840-d799-4c4d-8f06-16e26d16580d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Getting quotas for project 1422bbfed9414b8cada1656aed195a31. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:58:45.417684 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-9969f840-d799-4c4d-8f06-16e26d16580d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Getting quotas for user 1daca2cfac58487189f1fe8bf4bcb130 and project 1422bbfed9414b8cada1656aed195a31. Resources: {'key_pairs'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:58:45.471148 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9969f840-d799-4c4d-8f06-16e26d16580d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087288 Aug 24 17:58:45.483746 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 525/1023] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Aug 24 17:58:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:46.794942 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-764523667", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29fbbcf6-c646-4aae-ba1c-126437193f4d"}], "security_groups": [{"name": "tempest-securitygroup--1770577225"}], "key_name": "tempest-keypair-1214763961", "user_data": "}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:46.896448 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.network.neutron [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] validate_networks() for [('29fbbcf6-c646-4aae-ba1c-126437193f4d', None, None, None, None, None)] {{(pid=126993) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:58:47.123275 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1809602226", "imageRef": "89d47663-f8b0-46a3-8c88-60bb544cad6d", "flavorRef": "452"}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:47.174467 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.network.neutron [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] validate_networks() for None {{(pid=126994) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 17:58:47.381062 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Flavor limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:58:47.381485 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Image limits 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:58:47.381967 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Flavor pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:58:47.382378 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Image pref 0:0:0 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:58:47.382794 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.virt.hardware [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:58:47.391571 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:47.392057 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:47.392497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:47.393229 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:47.393689 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:47.394114 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:47.411803 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Getting quotas for project 1422bbfed9414b8cada1656aed195a31. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:58:47.416428 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.quota [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Getting quotas for user 1daca2cfac58487189f1fe8bf4bcb130 and project 1422bbfed9414b8cada1656aed195a31. Resources: {'instances', 'cores', 'ram'} {{(pid=126993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:58:47.427588 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Going to run 1 instances... {{(pid=126993) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:58:47.430008 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:58:47.452371 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Flavor limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 17:58:47.452863 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Image limits 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 17:58:47.453338 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Flavor pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 17:58:47.453745 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Image pref 0:0:0 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 17:58:47.454156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.virt.hardware [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 17:58:47.464035 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:47.464524 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:47.464963 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:47.465718 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:47.466169 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:47.466591 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:47.480006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-f8d1b7da-4c39-412a-99f0-6480b259150f tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.689938 Aug 24 17:58:47.480890 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 499/1024] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:58:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 17:58:47.491776 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Getting quotas for project d62cbdfea83843ed92d1d42055e24ed3. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 17:58:47.492415 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-315322f9-47dc-4ddb-9395-2c081a56da70 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:47.493271 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-315322f9-47dc-4ddb-9395-2c081a56da70 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:47.496109 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.quota [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Getting quotas for user 499ecab70f4c4c1dbf0be673be5eb52c and project d62cbdfea83843ed92d1d42055e24ed3. Resources: {'instances', 'cores', 'ram'} {{(pid=126994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 17:58:47.507180 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Going to run 1 instances... {{(pid=126994) _provision_instances /opt/stack/nova/nova/compute/api.py:1401}} Aug 24 17:58:47.515165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89d47663-f8b0-46a3-8c88-60bb544cad6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1862}} Aug 24 17:58:47.557151 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-315322f9-47dc-4ddb-9395-2c081a56da70 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:47.563139 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4184f7ba-401a-46d6-a03d-a0160302a3e2 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.444676 Aug 24 17:58:47.564061 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 526/1025] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Aug 24 17:58:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 17:58:47.574527 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-315322f9-47dc-4ddb-9395-2c081a56da70 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 200 len: 1237 microversion: 2.1 time: 0.086550 Aug 24 17:58:47.575920 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 500/1026] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:47 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:58:47.579522 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ce017092-bb2a-40db-8ed5-0726e0776b75 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:47.580149 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ce017092-bb2a-40db-8ed5-0726e0776b75 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:47.651914 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-ce017092-bb2a-40db-8ed5-0726e0776b75 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499ecab70f4c4c1dbf0be673be5eb52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62cbdfea83843ed92d1d42055e24ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:47.660698 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ce017092-bb2a-40db-8ed5-0726e0776b75 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 200 len: 1215 microversion: 2.1 time: 0.085290 Aug 24 17:58:47.668669 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 527/1027] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:47 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:48.596209 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ccebcc61-3aaa-424d-8925-2da45c81afdd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:48.596825 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ccebcc61-3aaa-424d-8925-2da45c81afdd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:48.604083 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ccebcc61-3aaa-424d-8925-2da45c81afdd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:48.604565 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ccebcc61-3aaa-424d-8925-2da45c81afdd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:48.605005 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ccebcc61-3aaa-424d-8925-2da45c81afdd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:48.605702 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ccebcc61-3aaa-424d-8925-2da45c81afdd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:48.606159 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ccebcc61-3aaa-424d-8925-2da45c81afdd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:48.606584 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ccebcc61-3aaa-424d-8925-2da45c81afdd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:48.686429 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-07e5ecfc-3694-49b7-9753-92cbb6a04546 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:48.687950 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-07e5ecfc-3694-49b7-9753-92cbb6a04546 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:48.699003 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-07e5ecfc-3694-49b7-9753-92cbb6a04546 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:48.699576 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ccebcc61-3aaa-424d-8925-2da45c81afdd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:48.700153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-07e5ecfc-3694-49b7-9753-92cbb6a04546 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:48.700866 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-07e5ecfc-3694-49b7-9753-92cbb6a04546 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:48.701667 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-07e5ecfc-3694-49b7-9753-92cbb6a04546 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:48.703107 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-07e5ecfc-3694-49b7-9753-92cbb6a04546 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:48.704578 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-07e5ecfc-3694-49b7-9753-92cbb6a04546 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:48.713770 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ccebcc61-3aaa-424d-8925-2da45c81afdd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 200 len: 1297 microversion: 2.1 time: 0.121545 Aug 24 17:58:48.714973 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 501/1028] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:48 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 1297 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:48.803174 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-07e5ecfc-3694-49b7-9753-92cbb6a04546 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499ecab70f4c4c1dbf0be673be5eb52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62cbdfea83843ed92d1d42055e24ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:48.813186 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-07e5ecfc-3694-49b7-9753-92cbb6a04546 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 200 len: 1267 microversion: 2.1 time: 0.132897 Aug 24 17:58:48.814344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 528/1029] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:48 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 1267 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:49.734446 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-615687e8-3a5a-4e0b-95d2-3a2a7227a579 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:49.735061 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-615687e8-3a5a-4e0b-95d2-3a2a7227a579 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:49.742564 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-615687e8-3a5a-4e0b-95d2-3a2a7227a579 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:49.743870 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-615687e8-3a5a-4e0b-95d2-3a2a7227a579 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:49.744479 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-615687e8-3a5a-4e0b-95d2-3a2a7227a579 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:49.745625 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-615687e8-3a5a-4e0b-95d2-3a2a7227a579 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:49.746551 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-615687e8-3a5a-4e0b-95d2-3a2a7227a579 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:49.747241 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-615687e8-3a5a-4e0b-95d2-3a2a7227a579 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:49.835216 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-959652c7-d637-4013-bcf6-8fec84dd80d5 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:49.835906 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-959652c7-d637-4013-bcf6-8fec84dd80d5 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:49.844054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-959652c7-d637-4013-bcf6-8fec84dd80d5 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:49.845117 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-959652c7-d637-4013-bcf6-8fec84dd80d5 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:49.845833 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-959652c7-d637-4013-bcf6-8fec84dd80d5 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:49.846918 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-959652c7-d637-4013-bcf6-8fec84dd80d5 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:49.847565 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-959652c7-d637-4013-bcf6-8fec84dd80d5 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:49.848275 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-959652c7-d637-4013-bcf6-8fec84dd80d5 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:49.991087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-615687e8-3a5a-4e0b-95d2-3a2a7227a579 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:49.999656 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-615687e8-3a5a-4e0b-95d2-3a2a7227a579 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 200 len: 1363 microversion: 2.1 time: 0.269158 Aug 24 17:58:50.007921 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 502/1030] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:49 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:50.064810 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-959652c7-d637-4013-bcf6-8fec84dd80d5 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499ecab70f4c4c1dbf0be673be5eb52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62cbdfea83843ed92d1d42055e24ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:50.074703 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-959652c7-d637-4013-bcf6-8fec84dd80d5 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 200 len: 1315 microversion: 2.1 time: 0.243392 Aug 24 17:58:50.075715 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 529/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:49 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:50.232755 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-6c19809e-649f-4cba-b27f-4770cbcafc6e req-96a8ff3a-0c24-431c-beb7-bcd54a6fcb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a085f3-3fa8-4076-9add-aed8d7b0da72", "tag": "4835fab0-24ea-4239-824b-d93c2d2a1697"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:50.243892 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-6c19809e-649f-4cba-b27f-4770cbcafc6e req-96a8ff3a-0c24-431c-beb7-bcd54a6fcb02 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:50.244313 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-6c19809e-649f-4cba-b27f-4770cbcafc6e req-96a8ff3a-0c24-431c-beb7-bcd54a6fcb02 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:50.244987 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-6c19809e-649f-4cba-b27f-4770cbcafc6e req-96a8ff3a-0c24-431c-beb7-bcd54a6fcb02 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:50.260432 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-6c19809e-649f-4cba-b27f-4770cbcafc6e req-96a8ff3a-0c24-431c-beb7-bcd54a6fcb02 service nova] Creating event network-changed:4835fab0-24ea-4239-824b-d93c2d2a1697 for instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 on hv-cinder-84052 Aug 24 17:58:50.267210 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-6c19809e-649f-4cba-b27f-4770cbcafc6e req-96a8ff3a-0c24-431c-beb7-bcd54a6fcb02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037641 Aug 24 17:58:50.268089 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 503/1032] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:50.545344 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-893f8c87-beaa-47a2-9afe-7c2f2b63ae9a req-a0f0e346-177a-43a1-a359-d1dcc1e1cac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4", "tag": "12b9c42e-6dd0-48bd-a1f9-501606d006ea"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:50.558089 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-893f8c87-beaa-47a2-9afe-7c2f2b63ae9a req-a0f0e346-177a-43a1-a359-d1dcc1e1cac7 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:50.558570 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-893f8c87-beaa-47a2-9afe-7c2f2b63ae9a req-a0f0e346-177a-43a1-a359-d1dcc1e1cac7 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:50.560067 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-893f8c87-beaa-47a2-9afe-7c2f2b63ae9a req-a0f0e346-177a-43a1-a359-d1dcc1e1cac7 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:50.573135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-893f8c87-beaa-47a2-9afe-7c2f2b63ae9a req-a0f0e346-177a-43a1-a359-d1dcc1e1cac7 service nova] Creating event network-changed:12b9c42e-6dd0-48bd-a1f9-501606d006ea for instance c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 on hv-cinder-84052 Aug 24 17:58:50.578212 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-893f8c87-beaa-47a2-9afe-7c2f2b63ae9a req-a0f0e346-177a-43a1-a359-d1dcc1e1cac7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195071 Aug 24 17:58:50.578753 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 530/1033] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:51.022320 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-9122092b-207b-444a-ad9a-e45e9d66d7cf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:51.023087 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-9122092b-207b-444a-ad9a-e45e9d66d7cf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:51.029271 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9122092b-207b-444a-ad9a-e45e9d66d7cf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:51.029755 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9122092b-207b-444a-ad9a-e45e9d66d7cf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:51.030194 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9122092b-207b-444a-ad9a-e45e9d66d7cf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:51.030886 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9122092b-207b-444a-ad9a-e45e9d66d7cf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:51.031345 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9122092b-207b-444a-ad9a-e45e9d66d7cf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:51.031811 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-9122092b-207b-444a-ad9a-e45e9d66d7cf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:51.099063 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-a2f2f816-2dc3-4890-8dba-342ea7f3455e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:51.099939 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-a2f2f816-2dc3-4890-8dba-342ea7f3455e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:51.107435 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2f2f816-2dc3-4890-8dba-342ea7f3455e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:51.107955 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2f2f816-2dc3-4890-8dba-342ea7f3455e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:51.108398 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2f2f816-2dc3-4890-8dba-342ea7f3455e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:51.109096 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2f2f816-2dc3-4890-8dba-342ea7f3455e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:51.109586 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2f2f816-2dc3-4890-8dba-342ea7f3455e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:51.110010 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-a2f2f816-2dc3-4890-8dba-342ea7f3455e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:51.162291 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-9122092b-207b-444a-ad9a-e45e9d66d7cf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:51.170699 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-9122092b-207b-444a-ad9a-e45e9d66d7cf tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 200 len: 1363 microversion: 2.1 time: 0.153201 Aug 24 17:58:51.171358 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 504/1034] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:51 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:51.242709 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-a2f2f816-2dc3-4890-8dba-342ea7f3455e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499ecab70f4c4c1dbf0be673be5eb52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62cbdfea83843ed92d1d42055e24ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:51.250335 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-a2f2f816-2dc3-4890-8dba-342ea7f3455e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 200 len: 1315 microversion: 2.1 time: 0.156568 Aug 24 17:58:51.250888 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 531/1035] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:51 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:58:52.191828 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ed71adef-e1e6-44ee-bb82-8f5e8f25ead6 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:52.192712 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ed71adef-e1e6-44ee-bb82-8f5e8f25ead6 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:52.200586 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ed71adef-e1e6-44ee-bb82-8f5e8f25ead6 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:52.201081 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ed71adef-e1e6-44ee-bb82-8f5e8f25ead6 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:52.201524 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ed71adef-e1e6-44ee-bb82-8f5e8f25ead6 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:52.202227 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ed71adef-e1e6-44ee-bb82-8f5e8f25ead6 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:52.202687 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ed71adef-e1e6-44ee-bb82-8f5e8f25ead6 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:52.203245 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ed71adef-e1e6-44ee-bb82-8f5e8f25ead6 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:52.206089 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:52.271563 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-2114de9d-e11d-4bb9-b04e-f572e33c406e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:52.272193 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-2114de9d-e11d-4bb9-b04e-f572e33c406e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:52.279227 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2114de9d-e11d-4bb9-b04e-f572e33c406e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:52.280011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2114de9d-e11d-4bb9-b04e-f572e33c406e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:52.280457 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2114de9d-e11d-4bb9-b04e-f572e33c406e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:52.281175 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2114de9d-e11d-4bb9-b04e-f572e33c406e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:52.281637 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2114de9d-e11d-4bb9-b04e-f572e33c406e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:52.282067 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-2114de9d-e11d-4bb9-b04e-f572e33c406e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:52.415810 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-ed71adef-e1e6-44ee-bb82-8f5e8f25ead6 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:52.424226 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ed71adef-e1e6-44ee-bb82-8f5e8f25ead6 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 200 len: 1363 microversion: 2.1 time: 0.236281 Aug 24 17:58:52.424805 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 505/1036] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:52 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:52.484032 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-2114de9d-e11d-4bb9-b04e-f572e33c406e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499ecab70f4c4c1dbf0be673be5eb52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62cbdfea83843ed92d1d42055e24ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:52.492481 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-2114de9d-e11d-4bb9-b04e-f572e33c406e tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 200 len: 1315 microversion: 2.1 time: 0.225078 Aug 24 17:58:52.493073 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 532/1037] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:52 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:58:53.446820 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-fb7bdfb4-4a85-4226-a240-c864775c77e3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:53.447453 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-fb7bdfb4-4a85-4226-a240-c864775c77e3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:53.453950 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fb7bdfb4-4a85-4226-a240-c864775c77e3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:53.454436 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fb7bdfb4-4a85-4226-a240-c864775c77e3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:53.454866 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fb7bdfb4-4a85-4226-a240-c864775c77e3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:53.455613 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fb7bdfb4-4a85-4226-a240-c864775c77e3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:53.456069 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fb7bdfb4-4a85-4226-a240-c864775c77e3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:53.456489 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-fb7bdfb4-4a85-4226-a240-c864775c77e3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:53.514229 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-878b8b5f-2007-4d01-9f75-3f91d627b21d tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:53.520891 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-878b8b5f-2007-4d01-9f75-3f91d627b21d tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:53.535573 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-878b8b5f-2007-4d01-9f75-3f91d627b21d tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:53.536064 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-878b8b5f-2007-4d01-9f75-3f91d627b21d tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:53.536557 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-878b8b5f-2007-4d01-9f75-3f91d627b21d tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:53.537415 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-878b8b5f-2007-4d01-9f75-3f91d627b21d tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:53.537714 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-878b8b5f-2007-4d01-9f75-3f91d627b21d tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:53.538135 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-878b8b5f-2007-4d01-9f75-3f91d627b21d tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:53.589276 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-fb7bdfb4-4a85-4226-a240-c864775c77e3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:53.597102 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-fb7bdfb4-4a85-4226-a240-c864775c77e3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 200 len: 1363 microversion: 2.1 time: 0.155107 Aug 24 17:58:53.597711 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 506/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:53 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:53.666081 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-878b8b5f-2007-4d01-9f75-3f91d627b21d tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499ecab70f4c4c1dbf0be673be5eb52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62cbdfea83843ed92d1d42055e24ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:53.672341 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-878b8b5f-2007-4d01-9f75-3f91d627b21d tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 200 len: 1315 microversion: 2.1 time: 0.162214 Aug 24 17:58:53.672907 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 533/1039] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:53 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:58:54.618515 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5b50d4f4-bed7-4349-8097-258bd2f91884 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:54.619138 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5b50d4f4-bed7-4349-8097-258bd2f91884 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:54.621552 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:54.626880 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b50d4f4-bed7-4349-8097-258bd2f91884 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:54.627413 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b50d4f4-bed7-4349-8097-258bd2f91884 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:54.627883 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b50d4f4-bed7-4349-8097-258bd2f91884 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:54.628772 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b50d4f4-bed7-4349-8097-258bd2f91884 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:54.629072 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b50d4f4-bed7-4349-8097-258bd2f91884 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:54.629470 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5b50d4f4-bed7-4349-8097-258bd2f91884 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:54.733053 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-874b9e5e-f2e8-4c4e-b78b-a34c70fe434c req-7cb7a948-be82-4301-a2ad-b61fe836e6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a085f3-3fa8-4076-9add-aed8d7b0da72", "name": "network-vif-plugged", "status": "completed", "tag": "4835fab0-24ea-4239-824b-d93c2d2a1697"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:54.743632 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-874b9e5e-f2e8-4c4e-b78b-a34c70fe434c req-7cb7a948-be82-4301-a2ad-b61fe836e6b5 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:54.744410 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-874b9e5e-f2e8-4c4e-b78b-a34c70fe434c req-7cb7a948-be82-4301-a2ad-b61fe836e6b5 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:54.744841 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-874b9e5e-f2e8-4c4e-b78b-a34c70fe434c req-7cb7a948-be82-4301-a2ad-b61fe836e6b5 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:54.758720 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-874b9e5e-f2e8-4c4e-b78b-a34c70fe434c req-7cb7a948-be82-4301-a2ad-b61fe836e6b5 service nova] Creating event network-vif-plugged:4835fab0-24ea-4239-824b-d93c2d2a1697 for instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 on hv-cinder-84052 Aug 24 17:58:54.763655 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-874b9e5e-f2e8-4c4e-b78b-a34c70fe434c req-7cb7a948-be82-4301-a2ad-b61fe836e6b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101211 Aug 24 17:58:54.764612 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 534/1040] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:54.770485 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b3da7e27-ca0c-409c-aeab-09631899c3a3 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:54.771574 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b3da7e27-ca0c-409c-aeab-09631899c3a3 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:54.778802 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b3da7e27-ca0c-409c-aeab-09631899c3a3 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:54.779780 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b3da7e27-ca0c-409c-aeab-09631899c3a3 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:54.781532 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b3da7e27-ca0c-409c-aeab-09631899c3a3 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:54.782485 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b3da7e27-ca0c-409c-aeab-09631899c3a3 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:54.783130 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b3da7e27-ca0c-409c-aeab-09631899c3a3 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:54.783759 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b3da7e27-ca0c-409c-aeab-09631899c3a3 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:54.811386 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-5b50d4f4-bed7-4349-8097-258bd2f91884 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:54.820299 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5b50d4f4-bed7-4349-8097-258bd2f91884 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 200 len: 1363 microversion: 2.1 time: 0.206273 Aug 24 17:58:54.822063 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 507/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:54 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:54.943806 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-b3da7e27-ca0c-409c-aeab-09631899c3a3 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499ecab70f4c4c1dbf0be673be5eb52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62cbdfea83843ed92d1d42055e24ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:54.952730 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b3da7e27-ca0c-409c-aeab-09631899c3a3 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 200 len: 1315 microversion: 2.1 time: 0.186933 Aug 24 17:58:54.953305 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 535/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:54 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:55.840958 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-d19f3310-76c6-4e35-afcc-58e87192c623 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:55.841510 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-d19f3310-76c6-4e35-afcc-58e87192c623 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:55.848011 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d19f3310-76c6-4e35-afcc-58e87192c623 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:55.848497 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d19f3310-76c6-4e35-afcc-58e87192c623 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:55.848936 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d19f3310-76c6-4e35-afcc-58e87192c623 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:55.849626 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d19f3310-76c6-4e35-afcc-58e87192c623 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:55.850082 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d19f3310-76c6-4e35-afcc-58e87192c623 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:55.850505 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-d19f3310-76c6-4e35-afcc-58e87192c623 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:55.976639 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7c6081ee-8300-41bf-be86-45641815d905 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:55.978768 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-7c6081ee-8300-41bf-be86-45641815d905 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:55.986255 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7c6081ee-8300-41bf-be86-45641815d905 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:55.986742 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7c6081ee-8300-41bf-be86-45641815d905 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:55.987179 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7c6081ee-8300-41bf-be86-45641815d905 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:55.988160 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7c6081ee-8300-41bf-be86-45641815d905 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:55.988734 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7c6081ee-8300-41bf-be86-45641815d905 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:55.989233 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-7c6081ee-8300-41bf-be86-45641815d905 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:55.992770 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:55.997430 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-d19f3310-76c6-4e35-afcc-58e87192c623 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:56.008274 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-d19f3310-76c6-4e35-afcc-58e87192c623 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 200 len: 1363 microversion: 2.1 time: 0.171156 Aug 24 17:58:56.009277 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 508/1043] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:55 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:58:56.136840 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-7c6081ee-8300-41bf-be86-45641815d905 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499ecab70f4c4c1dbf0be673be5eb52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62cbdfea83843ed92d1d42055e24ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:56.144510 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7c6081ee-8300-41bf-be86-45641815d905 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 200 len: 1315 microversion: 2.1 time: 0.173954 Aug 24 17:58:56.145079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 536/1044] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:55 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:58:56.779556 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-53ff7c76-e7ee-4c50-94f2-f5f877d15c5d req-ba6bb536-4399-426c-887a-224cab6489b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4", "name": "network-vif-plugged", "status": "completed", "tag": "12b9c42e-6dd0-48bd-a1f9-501606d006ea"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:56.788738 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-53ff7c76-e7ee-4c50-94f2-f5f877d15c5d req-ba6bb536-4399-426c-887a-224cab6489b5 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:56.789213 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-53ff7c76-e7ee-4c50-94f2-f5f877d15c5d req-ba6bb536-4399-426c-887a-224cab6489b5 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:56.790138 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-53ff7c76-e7ee-4c50-94f2-f5f877d15c5d req-ba6bb536-4399-426c-887a-224cab6489b5 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:56.800948 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-53ff7c76-e7ee-4c50-94f2-f5f877d15c5d req-ba6bb536-4399-426c-887a-224cab6489b5 service nova] Creating event network-vif-plugged:12b9c42e-6dd0-48bd-a1f9-501606d006ea for instance c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 on hv-cinder-84052 Aug 24 17:58:56.806597 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-53ff7c76-e7ee-4c50-94f2-f5f877d15c5d req-ba6bb536-4399-426c-887a-224cab6489b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030831 Aug 24 17:58:56.807158 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 509/1045] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:58:57.030154 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1709fad6-eae5-4b54-a147-021952dd8d3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:57.030715 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1709fad6-eae5-4b54-a147-021952dd8d3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:57.037281 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1709fad6-eae5-4b54-a147-021952dd8d3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:57.037768 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1709fad6-eae5-4b54-a147-021952dd8d3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:57.038228 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1709fad6-eae5-4b54-a147-021952dd8d3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:57.038923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1709fad6-eae5-4b54-a147-021952dd8d3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:57.039920 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1709fad6-eae5-4b54-a147-021952dd8d3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:57.040348 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1709fad6-eae5-4b54-a147-021952dd8d3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:57.166892 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c4dac6ca-1287-4c4c-aec5-1089c565ee51 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:57.167823 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c4dac6ca-1287-4c4c-aec5-1089c565ee51 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:57.170264 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1709fad6-eae5-4b54-a147-021952dd8d3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:57.173858 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c4dac6ca-1287-4c4c-aec5-1089c565ee51 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:57.174435 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c4dac6ca-1287-4c4c-aec5-1089c565ee51 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:57.174879 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c4dac6ca-1287-4c4c-aec5-1089c565ee51 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:57.175611 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c4dac6ca-1287-4c4c-aec5-1089c565ee51 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:57.176075 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c4dac6ca-1287-4c4c-aec5-1089c565ee51 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:57.176500 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c4dac6ca-1287-4c4c-aec5-1089c565ee51 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:57.177926 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1709fad6-eae5-4b54-a147-021952dd8d3b tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 200 len: 1549 microversion: 2.1 time: 0.151792 Aug 24 17:58:57.178483 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 537/1046] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:57 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:57.198096 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-33017436-1ee8-4b4e-b0b6-a6afcecce003 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:57.198582 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-33017436-1ee8-4b4e-b0b6-a6afcecce003 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:57.204420 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33017436-1ee8-4b4e-b0b6-a6afcecce003 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:57.204899 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33017436-1ee8-4b4e-b0b6-a6afcecce003 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:57.205325 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33017436-1ee8-4b4e-b0b6-a6afcecce003 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:57.206011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33017436-1ee8-4b4e-b0b6-a6afcecce003 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:57.206458 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33017436-1ee8-4b4e-b0b6-a6afcecce003 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:57.206876 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-33017436-1ee8-4b4e-b0b6-a6afcecce003 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:57.283227 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-33017436-1ee8-4b4e-b0b6-a6afcecce003 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088743 Aug 24 17:58:57.283846 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 538/1047] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Aug 24 17:58:57 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:58:57.306474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-c4dac6ca-1287-4c4c-aec5-1089c565ee51 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499ecab70f4c4c1dbf0be673be5eb52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62cbdfea83843ed92d1d42055e24ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:57.314185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c4dac6ca-1287-4c4c-aec5-1089c565ee51 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 200 len: 1315 microversion: 2.1 time: 0.152880 Aug 24 17:58:57.314756 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 510/1048] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:57 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 17:58:58.331846 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=2 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:58.333251 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell0:SELECT=12 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:58.337633 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-4531c0ef-eaea-4076-aa62-b4b8d0eacc31 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:58.338254 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-4531c0ef-eaea-4076-aa62-b4b8d0eacc31 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:58.347217 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4531c0ef-eaea-4076-aa62-b4b8d0eacc31 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:58.347739 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4531c0ef-eaea-4076-aa62-b4b8d0eacc31 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:58.348190 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4531c0ef-eaea-4076-aa62-b4b8d0eacc31 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:58.348879 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4531c0ef-eaea-4076-aa62-b4b8d0eacc31 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:58.349337 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4531c0ef-eaea-4076-aa62-b4b8d0eacc31 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:58.349762 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-4531c0ef-eaea-4076-aa62-b4b8d0eacc31 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:58.476470 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [req-940b2957-9d00-4065-8b0c-957a66c68019 req-5430410f-e22c-493d-8f07-afb125d789da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a085f3-3fa8-4076-9add-aed8d7b0da72", "tag": "4835fab0-24ea-4239-824b-d93c2d2a1697"}]} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:58:58.482474 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=2 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:58.483429 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell0:SELECT=8 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:58:58.490326 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-940b2957-9d00-4065-8b0c-957a66c68019 req-5430410f-e22c-493d-8f07-afb125d789da service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:58.490937 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-940b2957-9d00-4065-8b0c-957a66c68019 req-5430410f-e22c-493d-8f07-afb125d789da service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:58.491489 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [req-940b2957-9d00-4065-8b0c-957a66c68019 req-5430410f-e22c-493d-8f07-afb125d789da service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:58.503635 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.compute.server_external_events [req-940b2957-9d00-4065-8b0c-957a66c68019 req-5430410f-e22c-493d-8f07-afb125d789da service nova] Creating event network-changed:4835fab0-24ea-4239-824b-d93c2d2a1697 for instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 on hv-cinder-84052 Aug 24 17:58:58.508814 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [req-940b2957-9d00-4065-8b0c-957a66c68019 req-5430410f-e22c-493d-8f07-afb125d789da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035969 Aug 24 17:58:58.509744 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 511/1049] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:58:58.523011 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-4531c0ef-eaea-4076-aa62-b4b8d0eacc31 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499ecab70f4c4c1dbf0be673be5eb52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62cbdfea83843ed92d1d42055e24ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:58.530398 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-4531c0ef-eaea-4076-aa62-b4b8d0eacc31 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 200 len: 1463 microversion: 2.1 time: 0.199145 Aug 24 17:58:58.530896 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 539/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:58 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 1463 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:58.577862 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-4c6c3837-84e2-4dc5-8345-1eb02fab110f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:58.578534 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4c6c3837-84e2-4dc5-8345-1eb02fab110f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:58.584879 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4c6c3837-84e2-4dc5-8345-1eb02fab110f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:58.585491 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4c6c3837-84e2-4dc5-8345-1eb02fab110f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:58.585994 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4c6c3837-84e2-4dc5-8345-1eb02fab110f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:58.587737 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4c6c3837-84e2-4dc5-8345-1eb02fab110f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:58.587919 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4c6c3837-84e2-4dc5-8345-1eb02fab110f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:58.588413 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-4c6c3837-84e2-4dc5-8345-1eb02fab110f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:58.614747 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-4c6c3837-84e2-4dc5-8345-1eb02fab110f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Going to try to terminate instance {{(pid=126993) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:58:58.699817 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-4c6c3837-84e2-4dc5-8345-1eb02fab110f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 204 len: 0 microversion: 2.1 time: 0.125955 Aug 24 17:58:58.700708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 512/1051] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:58:58 2022] DELETE /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:58:58.709558 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-90c0f450-bdf2-4670-9e78-1e519a0a1cbc tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:58.710173 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-90c0f450-bdf2-4670-9e78-1e519a0a1cbc tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:58.716670 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-90c0f450-bdf2-4670-9e78-1e519a0a1cbc tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:58.717145 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-90c0f450-bdf2-4670-9e78-1e519a0a1cbc tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:58.717575 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-90c0f450-bdf2-4670-9e78-1e519a0a1cbc tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:58.718280 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-90c0f450-bdf2-4670-9e78-1e519a0a1cbc tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:58.718749 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-90c0f450-bdf2-4670-9e78-1e519a0a1cbc tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:58.719165 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-90c0f450-bdf2-4670-9e78-1e519a0a1cbc tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:58.850979 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-90c0f450-bdf2-4670-9e78-1e519a0a1cbc tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499ecab70f4c4c1dbf0be673be5eb52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62cbdfea83843ed92d1d42055e24ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:58:58.859556 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-90c0f450-bdf2-4670-9e78-1e519a0a1cbc tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 200 len: 1469 microversion: 2.1 time: 0.153947 Aug 24 17:58:58.860246 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 540/1052] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:58 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:58:59.881533 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b204ea45-8c74-46dc-9543-2af524960a1f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:58:59.882233 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b204ea45-8c74-46dc-9543-2af524960a1f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:58:59.888805 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b204ea45-8c74-46dc-9543-2af524960a1f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:59.889285 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b204ea45-8c74-46dc-9543-2af524960a1f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:59.889720 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b204ea45-8c74-46dc-9543-2af524960a1f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:58:59.890417 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b204ea45-8c74-46dc-9543-2af524960a1f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:58:59.890869 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b204ea45-8c74-46dc-9543-2af524960a1f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:58:59.891290 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b204ea45-8c74-46dc-9543-2af524960a1f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:00.095359 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-b204ea45-8c74-46dc-9543-2af524960a1f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '499ecab70f4c4c1dbf0be673be5eb52c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62cbdfea83843ed92d1d42055e24ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:00.104708 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b204ea45-8c74-46dc-9543-2af524960a1f tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 200 len: 1469 microversion: 2.1 time: 0.227332 Aug 24 17:59:00.105415 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 513/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:58:59 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 1469 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:00.524665 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-ed9b4233-d532-4644-a002-408b4fcfbe44 req-f876fa2b-b518-4740-bc9e-14912e043efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4", "name": "network-vif-deleted", "tag": "12b9c42e-6dd0-48bd-a1f9-501606d006ea"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:00.530022 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:00.538953 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ed9b4233-d532-4644-a002-408b4fcfbe44 req-f876fa2b-b518-4740-bc9e-14912e043efe service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:00.539727 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ed9b4233-d532-4644-a002-408b4fcfbe44 req-f876fa2b-b518-4740-bc9e-14912e043efe service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:00.540164 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-ed9b4233-d532-4644-a002-408b4fcfbe44 req-f876fa2b-b518-4740-bc9e-14912e043efe service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:00.554797 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-ed9b4233-d532-4644-a002-408b4fcfbe44 req-f876fa2b-b518-4740-bc9e-14912e043efe service nova] Creating event network-vif-deleted:12b9c42e-6dd0-48bd-a1f9-501606d006ea for instance c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 on hv-cinder-84052 Aug 24 17:59:00.560865 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-ed9b4233-d532-4644-a002-408b4fcfbe44 req-f876fa2b-b518-4740-bc9e-14912e043efe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040498 Aug 24 17:59:00.561705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 541/1054] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:59:01.125344 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-cc41c189-e038-4605-9da9-817be3cb6950 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:01.125891 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-cc41c189-e038-4605-9da9-817be3cb6950 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] [instance: c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:01.132368 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cc41c189-e038-4605-9da9-817be3cb6950 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:01.132910 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cc41c189-e038-4605-9da9-817be3cb6950 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:01.133865 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cc41c189-e038-4605-9da9-817be3cb6950 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:01.134555 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cc41c189-e038-4605-9da9-817be3cb6950 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:01.135003 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cc41c189-e038-4605-9da9-817be3cb6950 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:01.135421 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cc41c189-e038-4605-9da9-817be3cb6950 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:01.148520 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-cc41c189-e038-4605-9da9-817be3cb6950 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] HTTP exception thrown: Instance c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 could not be found. Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-cc41c189-e038-4605-9da9-817be3cb6950 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Request method failure captured: Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 HTTP/1.1 Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmbV_GVj9XaWvcQ7Z_53bz154MzXw_onkgaYmY0Q3xvgVPahjnQeMlrQu4duDaeU3E5xC94JFbK8cfdh0jSi7HoZojEg1arFrzps3M-7WrDP87Z8shAZmgsQu91aSNHjt2e8M2Rojb8rcKRqDOJi1WujqDQNhsIYdo7SRSqvLZ0Hxvc Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: d62cbdfea83843ed92d1d42055e24ed3 Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-VolumesNegativeTest-1323263227 Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:59:01.150127 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:59:01.151915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d62cbdfea83843ed92d1d42055e24ed3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d62cbdfea83843ed92d1d42055e24ed3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d62cbdfea83843ed92d1d42055e24ed3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d62cbdfea83843ed92d1d42055e24ed3"}]}] Aug 24 17:59:01.151915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-VolumesNegativeTest-1323263227 Aug 24 17:59:01.151915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: d62cbdfea83843ed92d1d42055e24ed3 Aug 24 17:59:01.151915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-VolumesNegativeTest-1323263227 Aug 24 17:59:01.151915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-VolumesNegativeTest-1323263227-project Aug 24 17:59:01.151915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:59:01.151915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:59:01.151915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 499ecab70f4c4c1dbf0be673be5eb52c Aug 24 17:59:01.151915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-VolumesNegativeTest-1323263227-project Aug 24 17:59:01.151915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:59:01.151915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 could not be found. Aug 24 17:59:01.151915 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': 'c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4'} Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 could not be found. Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:59:01.153006 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 could not be found. Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 could not be found. Aug 24 17:59:01.154628 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:59:01.156103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-cc41c189-e038-4605-9da9-817be3cb6950 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] Returning 404 to user: Instance c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:59:01.156103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-cc41c189-e038-4605-9da9-817be3cb6950 tempest-VolumesNegativeTest-1323263227 tempest-VolumesNegativeTest-1323263227-project] 10.222.0.27 "GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4" status: 404 len: 111 microversion: 2.1 time: 0.030136 Aug 24 17:59:01.156103 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 514/1055] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:01 2022] GET /compute/v2.1/servers/c12b0bf5-2e04-4ac7-8c5a-5fb4480d1ba4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 17:59:34.705782 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG dbcounter [-] [126994] Writing DB stats nova_cell1:SELECT=29 {{(pid=126994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:34.710194 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-9e7f9c17-25f5-4ccf-b414-dcb24e4fce41 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:34.710777 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-9e7f9c17-25f5-4ccf-b414-dcb24e4fce41 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:34.717771 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e7f9c17-25f5-4ccf-b414-dcb24e4fce41 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:34.718256 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e7f9c17-25f5-4ccf-b414-dcb24e4fce41 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:34.718695 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e7f9c17-25f5-4ccf-b414-dcb24e4fce41 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:34.719388 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e7f9c17-25f5-4ccf-b414-dcb24e4fce41 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:34.719874 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e7f9c17-25f5-4ccf-b414-dcb24e4fce41 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:34.720300 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-9e7f9c17-25f5-4ccf-b414-dcb24e4fce41 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:34.742643 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-9e7f9c17-25f5-4ccf-b414-dcb24e4fce41 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/ips" status: 200 len: 146 microversion: 2.1 time: 0.038633 Aug 24 17:59:34.743201 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 542/1056] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Aug 24 17:59:34 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:36.071014 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-28d6c02a-9a0e-4cea-9930-4bd679cf9df8 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ae57770-f4b6-454f-912c-8469a62035b6"}} {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:36.074149 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-28d6c02a-9a0e-4cea-9930-4bd679cf9df8 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:36.076542 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:36.077202 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG dbcounter [-] [126993] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:59:36.082950 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-28d6c02a-9a0e-4cea-9930-4bd679cf9df8 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:36.083435 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-28d6c02a-9a0e-4cea-9930-4bd679cf9df8 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:36.083897 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-28d6c02a-9a0e-4cea-9930-4bd679cf9df8 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:36.084591 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-28d6c02a-9a0e-4cea-9930-4bd679cf9df8 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:36.085047 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-28d6c02a-9a0e-4cea-9930-4bd679cf9df8 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:36.085473 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-28d6c02a-9a0e-4cea-9930-4bd679cf9df8 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:36.323160 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-28d6c02a-9a0e-4cea-9930-4bd679cf9df8 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "POST /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256165 Aug 24 17:59:36.324032 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 515/1057] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:59:36 2022] POST /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:42.779290 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-cc046dce-a47a-42af-86da-8b9d9f2ba28c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:42.781459 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-cc046dce-a47a-42af-86da-8b9d9f2ba28c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:42.787823 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cc046dce-a47a-42af-86da-8b9d9f2ba28c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:42.788274 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cc046dce-a47a-42af-86da-8b9d9f2ba28c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:42.788711 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cc046dce-a47a-42af-86da-8b9d9f2ba28c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:42.789397 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cc046dce-a47a-42af-86da-8b9d9f2ba28c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:42.789855 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cc046dce-a47a-42af-86da-8b9d9f2ba28c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:42.790278 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-cc046dce-a47a-42af-86da-8b9d9f2ba28c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:42.825197 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-cc046dce-a47a-42af-86da-8b9d9f2ba28c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049408 Aug 24 17:59:42.826232 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 543/1058] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:59:42 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 17:59:42.837770 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-c83c626d-1112-43b5-837f-20ac60586b79 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:42.838375 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-c83c626d-1112-43b5-837f-20ac60586b79 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:42.845109 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c83c626d-1112-43b5-837f-20ac60586b79 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:42.845594 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c83c626d-1112-43b5-837f-20ac60586b79 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:42.846032 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c83c626d-1112-43b5-837f-20ac60586b79 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:42.846727 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c83c626d-1112-43b5-837f-20ac60586b79 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:42.847186 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c83c626d-1112-43b5-837f-20ac60586b79 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:42.847642 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-c83c626d-1112-43b5-837f-20ac60586b79 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:42.876854 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-c83c626d-1112-43b5-837f-20ac60586b79 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments/7ae57770-f4b6-454f-912c-8469a62035b6" status: 200 len: 194 microversion: 2.1 time: 0.043428 Aug 24 17:59:42.877420 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 516/1059] 10.222.0.27 () {58 vars in 1413 bytes} [Wed Aug 24 17:59:42 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments/7ae57770-f4b6-454f-912c-8469a62035b6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:44.195140 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-02d8e809-d676-4c8c-a01f-cb40d1e6e3fd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ef5d265-2b4d-43d1-b99d-4c405e5d4d34"}} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:44.198153 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-02d8e809-d676-4c8c-a01f-cb40d1e6e3fd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:44.204546 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-02d8e809-d676-4c8c-a01f-cb40d1e6e3fd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:44.205025 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-02d8e809-d676-4c8c-a01f-cb40d1e6e3fd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:44.205454 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-02d8e809-d676-4c8c-a01f-cb40d1e6e3fd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:44.206132 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-02d8e809-d676-4c8c-a01f-cb40d1e6e3fd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:44.206584 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-02d8e809-d676-4c8c-a01f-cb40d1e6e3fd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:44.207029 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-02d8e809-d676-4c8c-a01f-cb40d1e6e3fd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:44.437587 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-02d8e809-d676-4c8c-a01f-cb40d1e6e3fd tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "POST /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246419 Aug 24 17:59:44.438206 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 544/1060] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Aug 24 17:59:44 2022] POST /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:50.901559 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2271cd73-395d-40ba-92d6-a17eb25e15ee tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:50.903894 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2271cd73-395d-40ba-92d6-a17eb25e15ee tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:50.910397 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2271cd73-395d-40ba-92d6-a17eb25e15ee tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:50.910883 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2271cd73-395d-40ba-92d6-a17eb25e15ee tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:50.911315 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2271cd73-395d-40ba-92d6-a17eb25e15ee tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:50.912032 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2271cd73-395d-40ba-92d6-a17eb25e15ee tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:50.912489 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2271cd73-395d-40ba-92d6-a17eb25e15ee tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:50.912916 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2271cd73-395d-40ba-92d6-a17eb25e15ee tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:50.942983 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2271cd73-395d-40ba-92d6-a17eb25e15ee tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045201 Aug 24 17:59:50.943523 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 517/1061] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:59:50 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:51.082429 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-5b249d56-c55f-4db9-b507-a27b19378636 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:51.082968 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-5b249d56-c55f-4db9-b507-a27b19378636 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:51.089134 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5b249d56-c55f-4db9-b507-a27b19378636 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:51.089619 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5b249d56-c55f-4db9-b507-a27b19378636 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:51.090057 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5b249d56-c55f-4db9-b507-a27b19378636 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:51.090749 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5b249d56-c55f-4db9-b507-a27b19378636 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:51.091207 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5b249d56-c55f-4db9-b507-a27b19378636 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:51.091674 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-5b249d56-c55f-4db9-b507-a27b19378636 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:51.121396 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-5b249d56-c55f-4db9-b507-a27b19378636 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments/7ae57770-f4b6-454f-912c-8469a62035b6" status: 200 len: 194 microversion: 2.1 time: 0.043990 Aug 24 17:59:51.121967 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 545/1062] 10.222.0.27 () {58 vars in 1413 bytes} [Wed Aug 24 17:59:51 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments/7ae57770-f4b6-454f-912c-8469a62035b6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:51.132139 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-b8455adc-7a3a-4794-a993-b563e2f662d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:51.132633 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-b8455adc-7a3a-4794-a993-b563e2f662d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:51.138478 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8455adc-7a3a-4794-a993-b563e2f662d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:51.138961 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8455adc-7a3a-4794-a993-b563e2f662d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:51.139392 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8455adc-7a3a-4794-a993-b563e2f662d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:51.140120 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8455adc-7a3a-4794-a993-b563e2f662d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:51.140575 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8455adc-7a3a-4794-a993-b563e2f662d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:51.140997 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-b8455adc-7a3a-4794-a993-b563e2f662d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:51.222807 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-b8455adc-7a3a-4794-a993-b563e2f662d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lazy-loading 'services' on Instance uuid a0a085f3-3fa8-4076-9add-aed8d7b0da72 {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:59:51.296887 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-b8455adc-7a3a-4794-a993-b563e2f662d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments/7ae57770-f4b6-454f-912c-8469a62035b6" status: 202 len: 0 microversion: 2.1 time: 0.168488 Aug 24 17:59:51.297468 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 518/1063] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 17:59:51 2022] DELETE /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments/7ae57770-f4b6-454f-912c-8469a62035b6 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:59:52.412186 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-3bcaa842-2a52-457b-87df-96e901ccb8d3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:52.412698 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-3bcaa842-2a52-457b-87df-96e901ccb8d3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:52.418973 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3bcaa842-2a52-457b-87df-96e901ccb8d3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:52.419450 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3bcaa842-2a52-457b-87df-96e901ccb8d3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:52.419911 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3bcaa842-2a52-457b-87df-96e901ccb8d3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:52.420590 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3bcaa842-2a52-457b-87df-96e901ccb8d3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:52.421039 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3bcaa842-2a52-457b-87df-96e901ccb8d3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:52.421457 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-3bcaa842-2a52-457b-87df-96e901ccb8d3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:52.450208 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-3bcaa842-2a52-457b-87df-96e901ccb8d3 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments/6ef5d265-2b4d-43d1-b99d-4c405e5d4d34" status: 200 len: 194 microversion: 2.1 time: 0.041931 Aug 24 17:59:52.450761 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 546/1064] 10.222.0.27 () {58 vars in 1413 bytes} [Wed Aug 24 17:59:52 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments/6ef5d265-2b4d-43d1-b99d-4c405e5d4d34 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:52.462031 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-a239c36e-0792-44ad-bea4-36143d78ef63 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:52.462618 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-a239c36e-0792-44ad-bea4-36143d78ef63 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:52.468735 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a239c36e-0792-44ad-bea4-36143d78ef63 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:52.469217 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a239c36e-0792-44ad-bea4-36143d78ef63 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:52.469655 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a239c36e-0792-44ad-bea4-36143d78ef63 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:52.470348 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a239c36e-0792-44ad-bea4-36143d78ef63 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:52.470843 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a239c36e-0792-44ad-bea4-36143d78ef63 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:52.471272 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-a239c36e-0792-44ad-bea4-36143d78ef63 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:52.550556 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.objects.instance [None req-a239c36e-0792-44ad-bea4-36143d78ef63 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lazy-loading 'services' on Instance uuid a0a085f3-3fa8-4076-9add-aed8d7b0da72 {{(pid=126993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 17:59:52.622790 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-a239c36e-0792-44ad-bea4-36143d78ef63 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments/6ef5d265-2b4d-43d1-b99d-4c405e5d4d34" status: 202 len: 0 microversion: 2.1 time: 0.165376 Aug 24 17:59:52.623452 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 519/1065] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Aug 24 17:59:52 2022] DELETE /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments/6ef5d265-2b4d-43d1-b99d-4c405e5d4d34 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 17:59:53.793386 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-ab2ee897-c6b6-41c4-a41f-3a7262c0e8d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:53.795678 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-ab2ee897-c6b6-41c4-a41f-3a7262c0e8d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:53.802041 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ab2ee897-c6b6-41c4-a41f-3a7262c0e8d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:53.802533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ab2ee897-c6b6-41c4-a41f-3a7262c0e8d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:53.802969 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ab2ee897-c6b6-41c4-a41f-3a7262c0e8d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:53.803693 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ab2ee897-c6b6-41c4-a41f-3a7262c0e8d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:53.804154 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ab2ee897-c6b6-41c4-a41f-3a7262c0e8d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:53.804579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-ab2ee897-c6b6-41c4-a41f-3a7262c0e8d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:53.834705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-ab2ee897-c6b6-41c4-a41f-3a7262c0e8d1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045287 Aug 24 17:59:53.835247 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 547/1066] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:59:53 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:59:53.945262 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-80c5bbbc-e98c-4db1-89c8-c8ace92f1846 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:53.947663 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-80c5bbbc-e98c-4db1-89c8-c8ace92f1846 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:53.954410 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-80c5bbbc-e98c-4db1-89c8-c8ace92f1846 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:53.954893 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-80c5bbbc-e98c-4db1-89c8-c8ace92f1846 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:53.955324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-80c5bbbc-e98c-4db1-89c8-c8ace92f1846 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:53.956049 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-80c5bbbc-e98c-4db1-89c8-c8ace92f1846 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:53.956521 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-80c5bbbc-e98c-4db1-89c8-c8ace92f1846 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:53.956926 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-80c5bbbc-e98c-4db1-89c8-c8ace92f1846 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:53.984757 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-80c5bbbc-e98c-4db1-89c8-c8ace92f1846 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044468 Aug 24 17:59:53.985298 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 520/1067] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Aug 24 17:59:53 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 17:59:54.045018 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-b2f81750-d53a-4f60-9051-b81f22048a55 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:54.045519 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b2f81750-d53a-4f60-9051-b81f22048a55 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:54.051408 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b2f81750-d53a-4f60-9051-b81f22048a55 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:54.051940 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b2f81750-d53a-4f60-9051-b81f22048a55 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:54.052378 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b2f81750-d53a-4f60-9051-b81f22048a55 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:54.053062 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b2f81750-d53a-4f60-9051-b81f22048a55 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:54.053519 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b2f81750-d53a-4f60-9051-b81f22048a55 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:54.053940 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-b2f81750-d53a-4f60-9051-b81f22048a55 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:54.079819 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-b2f81750-d53a-4f60-9051-b81f22048a55 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Going to try to terminate instance {{(pid=126994) delete /opt/stack/nova/nova/compute/api.py:2717}} Aug 24 17:59:54.154766 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-b2f81750-d53a-4f60-9051-b81f22048a55 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 204 len: 0 microversion: 2.1 time: 0.113203 Aug 24 17:59:54.155527 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 548/1068] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 17:59:54 2022] DELETE /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 17:59:54.164330 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-cf181fb6-72fb-43bb-8e34-9992f5c92a5d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:54.164937 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-cf181fb6-72fb-43bb-8e34-9992f5c92a5d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:54.171394 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cf181fb6-72fb-43bb-8e34-9992f5c92a5d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:54.171908 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cf181fb6-72fb-43bb-8e34-9992f5c92a5d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:54.172339 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cf181fb6-72fb-43bb-8e34-9992f5c92a5d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:54.173022 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cf181fb6-72fb-43bb-8e34-9992f5c92a5d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:54.173469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cf181fb6-72fb-43bb-8e34-9992f5c92a5d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:54.173886 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-cf181fb6-72fb-43bb-8e34-9992f5c92a5d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:54.302397 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-cf181fb6-72fb-43bb-8e34-9992f5c92a5d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:54.310772 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-cf181fb6-72fb-43bb-8e34-9992f5c92a5d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 200 len: 1674 microversion: 2.1 time: 0.150393 Aug 24 17:59:54.311330 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 521/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:54 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:55.332499 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-1f8ac0cf-429b-4b56-b171-a0ce2ec7f442 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:55.333197 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-1f8ac0cf-429b-4b56-b171-a0ce2ec7f442 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:55.340223 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f8ac0cf-429b-4b56-b171-a0ce2ec7f442 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:55.340705 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f8ac0cf-429b-4b56-b171-a0ce2ec7f442 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:55.341144 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f8ac0cf-429b-4b56-b171-a0ce2ec7f442 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:55.341830 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f8ac0cf-429b-4b56-b171-a0ce2ec7f442 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:55.342333 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f8ac0cf-429b-4b56-b171-a0ce2ec7f442 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:55.342694 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-1f8ac0cf-429b-4b56-b171-a0ce2ec7f442 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:55.473299 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.policy [None req-1f8ac0cf-429b-4b56-b171-a0ce2ec7f442 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126994) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:55.481716 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-1f8ac0cf-429b-4b56-b171-a0ce2ec7f442 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 200 len: 1674 microversion: 2.1 time: 0.153475 Aug 24 17:59:55.482281 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 549/1070] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:55 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:56.503930 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-5ed33ecd-6b70-48a9-96f1-13ee14e60d9c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:56.504549 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-5ed33ecd-6b70-48a9-96f1-13ee14e60d9c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:56.510982 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5ed33ecd-6b70-48a9-96f1-13ee14e60d9c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:56.511498 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5ed33ecd-6b70-48a9-96f1-13ee14e60d9c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:56.511939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5ed33ecd-6b70-48a9-96f1-13ee14e60d9c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:56.512635 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5ed33ecd-6b70-48a9-96f1-13ee14e60d9c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:56.513151 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5ed33ecd-6b70-48a9-96f1-13ee14e60d9c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:56.513585 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-5ed33ecd-6b70-48a9-96f1-13ee14e60d9c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:56.582754 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.policy [None req-5ed33ecd-6b70-48a9-96f1-13ee14e60d9c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1daca2cfac58487189f1fe8bf4bcb130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1422bbfed9414b8cada1656aed195a31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126993) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 17:59:56.591185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-5ed33ecd-6b70-48a9-96f1-13ee14e60d9c tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 200 len: 1606 microversion: 2.1 time: 0.091064 Aug 24 17:59:56.603503 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 522/1071] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:56 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 1606 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 17:59:56.652118 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [req-c4b10654-56e4-4a49-b1da-ed8c00758e51 req-da40575c-5546-4ff3-8660-583dc5d3d5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a085f3-3fa8-4076-9add-aed8d7b0da72", "name": "network-vif-deleted", "tag": "4835fab0-24ea-4239-824b-d93c2d2a1697"}]} {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 17:59:56.663868 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-c4b10654-56e4-4a49-b1da-ed8c00758e51 req-da40575c-5546-4ff3-8660-583dc5d3d5d3 service nova] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:56.664436 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-c4b10654-56e4-4a49-b1da-ed8c00758e51 req-da40575c-5546-4ff3-8660-583dc5d3d5d3 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:56.664959 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [req-c4b10654-56e4-4a49-b1da-ed8c00758e51 req-da40575c-5546-4ff3-8660-583dc5d3d5d3 service nova] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:56.677419 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.compute.server_external_events [req-c4b10654-56e4-4a49-b1da-ed8c00758e51 req-da40575c-5546-4ff3-8660-583dc5d3d5d3 service nova] Creating event network-vif-deleted:4835fab0-24ea-4239-824b-d93c2d2a1697 for instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 on hv-cinder-84052 Aug 24 17:59:56.682910 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [req-c4b10654-56e4-4a49-b1da-ed8c00758e51 req-da40575c-5546-4ff3-8660-583dc5d3d5d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034748 Aug 24 17:59:56.684121 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 550/1072] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Aug 24 17:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 17:59:57.615040 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ae5ef0a4-1a8d-4088-9b45-587e711c85f5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:57.615606 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-ae5ef0a4-1a8d-4088-9b45-587e711c85f5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 17:59:57.621978 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ae5ef0a4-1a8d-4088-9b45-587e711c85f5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:57.622464 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ae5ef0a4-1a8d-4088-9b45-587e711c85f5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:57.622898 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ae5ef0a4-1a8d-4088-9b45-587e711c85f5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:57.623622 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ae5ef0a4-1a8d-4088-9b45-587e711c85f5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 17:59:57.624082 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ae5ef0a4-1a8d-4088-9b45-587e711c85f5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 17:59:57.624509 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-ae5ef0a4-1a8d-4088-9b45-587e711c85f5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 17:59:57.639351 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-ae5ef0a4-1a8d-4088-9b45-587e711c85f5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] HTTP exception thrown: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ae5ef0a4-1a8d-4088-9b45-587e711c85f5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Request method failure captured: Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 HTTP/1.1 Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmYhLpa-wCcqmk772WcGDCX6Jf6sEYrPUH455zY2sKe9op00ezw3NK8i3UkCxmICwXd5fQQTBxkheYvUc6PGLyoZNdKeGhqbB8d8a1HV55W-yihH1qXH6cY6dTh1UvQDBl0udhEmwzE0LAQoGVgaabYDo4QNJsBEFw7QtISazDZhmSk Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 1422bbfed9414b8cada1656aed195a31 Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeTestJSON-902035080 Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 17:59:57.641043 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 17:59:57.642768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1422bbfed9414b8cada1656aed195a31"}]}] Aug 24 17:59:57.642768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeTestJSON-902035080 Aug 24 17:59:57.642768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 1422bbfed9414b8cada1656aed195a31 Aug 24 17:59:57.642768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeTestJSON-902035080 Aug 24 17:59:57.642768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeTestJSON-902035080-project Aug 24 17:59:57.642768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 17:59:57.642768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 17:59:57.642768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 1daca2cfac58487189f1fe8bf4bcb130 Aug 24 17:59:57.642768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeTestJSON-902035080-project Aug 24 17:59:57.642768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 17:59:57.642768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 17:59:57.642768 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': 'a0a085f3-3fa8-4076-9add-aed8d7b0da72'} Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 17:59:57.643939 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 17:59:57.645469 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 17:59:57.646781 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-ae5ef0a4-1a8d-4088-9b45-587e711c85f5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Returning 404 to user: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 17:59:57.646781 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-ae5ef0a4-1a8d-4088-9b45-587e711c85f5 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 404 len: 111 microversion: 2.1 time: 0.031405 Aug 24 17:59:57.646781 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 523/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 17:59:57 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 17:59:57.653907 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-7c78a0b0-fced-409f-9b6a-20c3ec11e93d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '.version_select at 0x7f4b2985b0d0>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 17:59:57.672992 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-7c78a0b0-fced-409f-9b6a-20c3ec11e93d tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214763961" status: 202 len: 0 microversion: 2.1 time: 0.025214 Aug 24 17:59:57.673579 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 551/1074] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Aug 24 17:59:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214763961 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 18:00:00.538753 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2fde635b-250d-455f-bd8f-dea43c1ae313 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:00.539253 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-2fde635b-250d-455f-bd8f-dea43c1ae313 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:00.545696 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2fde635b-250d-455f-bd8f-dea43c1ae313 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:00.546185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2fde635b-250d-455f-bd8f-dea43c1ae313 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:00.546625 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2fde635b-250d-455f-bd8f-dea43c1ae313 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:00.547324 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2fde635b-250d-455f-bd8f-dea43c1ae313 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:00.547820 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2fde635b-250d-455f-bd8f-dea43c1ae313 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:00.548253 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-2fde635b-250d-455f-bd8f-dea43c1ae313 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:00.562069 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-2fde635b-250d-455f-bd8f-dea43c1ae313 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] HTTP exception thrown: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2fde635b-250d-455f-bd8f-dea43c1ae313 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Request method failure captured: Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: DELETE /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 HTTP/1.1 Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmYhLpa-wCcqmk772WcGDCX6Jf6sEYrPUH455zY2sKe9op00ezw3NK8i3UkCxmICwXd5fQQTBxkheYvUc6PGLyoZNdKeGhqbB8d8a1HV55W-yihH1qXH6cY6dTh1UvQDBl0udhEmwzE0LAQoGVgaabYDo4QNJsBEFw7QtISazDZhmSk Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 1422bbfed9414b8cada1656aed195a31 Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeTestJSON-902035080 Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 18:00:00.563766 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 18:00:00.565403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1422bbfed9414b8cada1656aed195a31"}]}] Aug 24 18:00:00.565403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeTestJSON-902035080 Aug 24 18:00:00.565403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 1422bbfed9414b8cada1656aed195a31 Aug 24 18:00:00.565403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeTestJSON-902035080 Aug 24 18:00:00.565403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeTestJSON-902035080-project Aug 24 18:00:00.565403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 18:00:00.565403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 18:00:00.565403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 1daca2cfac58487189f1fe8bf4bcb130 Aug 24 18:00:00.565403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeTestJSON-902035080-project Aug 24 18:00:00.565403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 18:00:00.565403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 18:00:00.565403 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': 'a0a085f3-3fa8-4076-9add-aed8d7b0da72'} Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 18:00:00.566454 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 18:00:00.568310 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 18:00:00.570185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-2fde635b-250d-455f-bd8f-dea43c1ae313 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Returning 404 to user: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 18:00:00.570185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-2fde635b-250d-455f-bd8f-dea43c1ae313 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 404 len: 111 microversion: 2.1 time: 0.030341 Aug 24 18:00:00.570185 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 524/1075] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 18:00:00 2022] DELETE /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 18:00:00.574756 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-442c1b03-46bd-489f-ac23-169f524d52e1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:00.575580 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-442c1b03-46bd-489f-ac23-169f524d52e1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: a0a085f3-3fa8-4076-9add-aed8d7b0da72] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:00.582537 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-442c1b03-46bd-489f-ac23-169f524d52e1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:00.583022 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-442c1b03-46bd-489f-ac23-169f524d52e1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:00.583457 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-442c1b03-46bd-489f-ac23-169f524d52e1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:00.584177 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-442c1b03-46bd-489f-ac23-169f524d52e1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:00.584632 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-442c1b03-46bd-489f-ac23-169f524d52e1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:00.585054 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-442c1b03-46bd-489f-ac23-169f524d52e1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:00.599542 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-442c1b03-46bd-489f-ac23-169f524d52e1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] HTTP exception thrown: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-442c1b03-46bd-489f-ac23-169f524d52e1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Request method failure captured: Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 HTTP/1.1 Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmYhLpa-wCcqmk772WcGDCX6Jf6sEYrPUH455zY2sKe9op00ezw3NK8i3UkCxmICwXd5fQQTBxkheYvUc6PGLyoZNdKeGhqbB8d8a1HV55W-yihH1qXH6cY6dTh1UvQDBl0udhEmwzE0LAQoGVgaabYDo4QNJsBEFw7QtISazDZhmSk Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 1422bbfed9414b8cada1656aed195a31 Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-AttachVolumeTestJSON-902035080 Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 18:00:00.601159 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 18:00:00.602744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1422bbfed9414b8cada1656aed195a31"}]}] Aug 24 18:00:00.602744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-AttachVolumeTestJSON-902035080 Aug 24 18:00:00.602744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 1422bbfed9414b8cada1656aed195a31 Aug 24 18:00:00.602744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-902035080 Aug 24 18:00:00.602744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-AttachVolumeTestJSON-902035080-project Aug 24 18:00:00.602744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 18:00:00.602744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 18:00:00.602744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 1daca2cfac58487189f1fe8bf4bcb130 Aug 24 18:00:00.602744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-AttachVolumeTestJSON-902035080-project Aug 24 18:00:00.602744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 18:00:00.602744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 18:00:00.602744 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': 'a0a085f3-3fa8-4076-9add-aed8d7b0da72'} Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 18:00:00.604156 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. Aug 24 18:00:00.605668 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 18:00:00.607124 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-442c1b03-46bd-489f-ac23-169f524d52e1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Returning 404 to user: Instance a0a085f3-3fa8-4076-9add-aed8d7b0da72 could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 18:00:00.607124 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-442c1b03-46bd-489f-ac23-169f524d52e1 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72" status: 404 len: 111 microversion: 2.1 time: 0.032281 Aug 24 18:00:00.607124 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 552/1076] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 18:00:00 2022] GET /compute/v2.1/servers/a0a085f3-3fa8-4076-9add-aed8d7b0da72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 18:00:01.742076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8ad60afd-83a5-4222-8550-1a50b4a03f2e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:01.742582 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.compute.api [None req-8ad60afd-83a5-4222-8550-1a50b4a03f2e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126993) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:01.749229 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8ad60afd-83a5-4222-8550-1a50b4a03f2e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:01.749715 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8ad60afd-83a5-4222-8550-1a50b4a03f2e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:01.750149 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8ad60afd-83a5-4222-8550-1a50b4a03f2e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:01.750843 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8ad60afd-83a5-4222-8550-1a50b4a03f2e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:01.751304 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8ad60afd-83a5-4222-8550-1a50b4a03f2e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:01.751756 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG oslo_concurrency.lockutils [None req-8ad60afd-83a5-4222-8550-1a50b4a03f2e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:01.765917 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.wsgi [None req-8ad60afd-83a5-4222-8550-1a50b4a03f2e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] HTTP exception thrown: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8ad60afd-83a5-4222-8550-1a50b4a03f2e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Request method failure captured: Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: request: DELETE /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 HTTP/1.1 Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept: application/json Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Accept-Encoding: identity Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Connection: close Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Length: 0 Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Content-Type: application/json Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Host: 10.222.0.27 Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Openstack-System-Scope: None Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: User-Agent: python-urllib3/1.26.11 Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Auth-Token: gAAAAABjBmYhLpa-wCcqmk772WcGDCX6Jf6sEYrPUH455zY2sKe9op00ezw3NK8i3UkCxmICwXd5fQQTBxkheYvUc6PGLyoZNdKeGhqbB8d8a1HV55W-yihH1qXH6cY6dTh1UvQDBl0udhEmwzE0LAQoGVgaabYDo4QNJsBEFw7QtISazDZhmSk Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Id: None Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Domain-Name: None Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Identity-Status: Confirmed Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Is-Admin-Project: True Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Id: default Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Domain-Name: Default Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Id: 1422bbfed9414b8cada1656aed195a31 Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Project-Name: tempest-AttachVolumeTestJSON-902035080 Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Role: reader,member Aug 24 18:00:01.767456 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Roles: reader,member Aug 24 18:00:01.769163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1422bbfed9414b8cada1656aed195a31"}]}] Aug 24 18:00:01.769163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant: tempest-AttachVolumeTestJSON-902035080 Aug 24 18:00:01.769163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Id: 1422bbfed9414b8cada1656aed195a31 Aug 24 18:00:01.769163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-Tenant-Name: tempest-AttachVolumeTestJSON-902035080 Aug 24 18:00:01.769163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User: tempest-AttachVolumeTestJSON-902035080-project Aug 24 18:00:01.769163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Id: default Aug 24 18:00:01.769163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Domain-Name: Default Aug 24 18:00:01.769163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Id: 1daca2cfac58487189f1fe8bf4bcb130 Aug 24 18:00:01.769163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: X-User-Name: tempest-AttachVolumeTestJSON-902035080-project Aug 24 18:00:01.769163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: method: > Aug 24 18:00:01.769163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: exception: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 18:00:01.769163 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: action_args: {'id': '1fbbd365-963e-4126-835c-d2a1725dfd77'} Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: {{(pid=126993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 18:00:01.770266 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 18:00:01.772076 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: ERROR nova.api.openstack.wsgi Aug 24 18:00:01.773720 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: DEBUG nova.api.openstack.wsgi [None req-8ad60afd-83a5-4222-8550-1a50b4a03f2e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Returning 404 to user: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. {{(pid=126993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 18:00:01.773720 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO nova.api.openstack.requestlog [None req-8ad60afd-83a5-4222-8550-1a50b4a03f2e tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 404 len: 111 microversion: 2.1 time: 0.030679 Aug 24 18:00:01.773720 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: [pid: 126993|app: 0|req: 525/1077] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Aug 24 18:00:01 2022] DELETE /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 18:00:01.777757 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-24bf5fe1-51e5-412a-9e6c-c9dbf3caec86 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Calling method '>' {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 18:00:01.778374 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.compute.api [None req-24bf5fe1-51e5-412a-9e6c-c9dbf3caec86 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] [instance: 1fbbd365-963e-4126-835c-d2a1725dfd77] Fetching instance by UUID {{(pid=126994) get /opt/stack/nova/nova/compute/api.py:2973}} Aug 24 18:00:01.785002 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-24bf5fe1-51e5-412a-9e6c-c9dbf3caec86 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:01.785493 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-24bf5fe1-51e5-412a-9e6c-c9dbf3caec86 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:01.785930 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-24bf5fe1-51e5-412a-9e6c-c9dbf3caec86 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:01.786623 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-24bf5fe1-51e5-412a-9e6c-c9dbf3caec86 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Acquiring lock "39b63279-b6ad-4ef4-bccd-f728c091053f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 18:00:01.787079 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-24bf5fe1-51e5-412a-9e6c-c9dbf3caec86 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 18:00:01.787533 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG oslo_concurrency.lockutils [None req-24bf5fe1-51e5-412a-9e6c-c9dbf3caec86 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Lock "39b63279-b6ad-4ef4-bccd-f728c091053f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 18:00:01.800529 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.wsgi [None req-24bf5fe1-51e5-412a-9e6c-c9dbf3caec86 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] HTTP exception thrown: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-24bf5fe1-51e5-412a-9e6c-c9dbf3caec86 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Request method failure captured: Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: request: GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 HTTP/1.1 Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept: application/json Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Accept-Encoding: identity Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Connection: close Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Length: 0 Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Content-Type: application/json Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Host: 10.222.0.27 Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Openstack-System-Scope: None Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: User-Agent: python-urllib3/1.26.11 Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Auth-Token: gAAAAABjBmYhLpa-wCcqmk772WcGDCX6Jf6sEYrPUH455zY2sKe9op00ezw3NK8i3UkCxmICwXd5fQQTBxkheYvUc6PGLyoZNdKeGhqbB8d8a1HV55W-yihH1qXH6cY6dTh1UvQDBl0udhEmwzE0LAQoGVgaabYDo4QNJsBEFw7QtISazDZhmSk Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Id: None Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Domain-Name: None Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Identity-Status: Confirmed Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Is-Admin-Project: True Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Id: default Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Domain-Name: Default Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Id: 1422bbfed9414b8cada1656aed195a31 Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Project-Name: tempest-AttachVolumeTestJSON-902035080 Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Role: reader,member Aug 24 18:00:01.802037 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Roles: reader,member Aug 24 18:00:01.803880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1422bbfed9414b8cada1656aed195a31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1422bbfed9414b8cada1656aed195a31"}]}] Aug 24 18:00:01.803880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant: tempest-AttachVolumeTestJSON-902035080 Aug 24 18:00:01.803880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Id: 1422bbfed9414b8cada1656aed195a31 Aug 24 18:00:01.803880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-902035080 Aug 24 18:00:01.803880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User: tempest-AttachVolumeTestJSON-902035080-project Aug 24 18:00:01.803880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Id: default Aug 24 18:00:01.803880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Domain-Name: Default Aug 24 18:00:01.803880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Id: 1daca2cfac58487189f1fe8bf4bcb130 Aug 24 18:00:01.803880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: X-User-Name: tempest-AttachVolumeTestJSON-902035080-project Aug 24 18:00:01.803880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: method: > Aug 24 18:00:01.803880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: exception: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 18:00:01.803880 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: action_args: {'id': '1fbbd365-963e-4126-835c-d2a1725dfd77'} Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: {{(pid=126994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2976, in get Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2880, in _get_instance_from_cell Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 18:00:01.804981 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. Aug 24 18:00:01.806478 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: ERROR nova.api.openstack.wsgi Aug 24 18:00:01.808077 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: DEBUG nova.api.openstack.wsgi [None req-24bf5fe1-51e5-412a-9e6c-c9dbf3caec86 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] Returning 404 to user: Instance 1fbbd365-963e-4126-835c-d2a1725dfd77 could not be found. {{(pid=126994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 18:00:01.808077 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO nova.api.openstack.requestlog [None req-24bf5fe1-51e5-412a-9e6c-c9dbf3caec86 tempest-AttachVolumeTestJSON-902035080 tempest-AttachVolumeTestJSON-902035080-project] 10.222.0.27 "GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77" status: 404 len: 111 microversion: 2.1 time: 0.030054 Aug 24 18:00:01.808077 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: [pid: 126994|app: 0|req: 553/1078] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Aug 24 18:00:01 2022] GET /compute/v2.1/servers/1fbbd365-963e-4126-835c-d2a1725dfd77 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 18:01:09.036008 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:01:09.036666 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Wed Aug 24 18:01:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:01:29.902685 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:01:29.903249 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Wed Aug 24 18:01:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:01:32.795359 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:01:32.795832 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Wed Aug 24 18:01:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:03:10.807138 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:03:10.807712 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Wed Aug 24 18:03:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:04:29.044533 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:04:29.045147 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Wed Aug 24 18:04:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:04:49.912689 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:04:49.913247 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Wed Aug 24 18:04:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:04:52.804970 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:04:52.806023 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Wed Aug 24 18:04:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:05:07.946346 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:05:07.946923 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Wed Aug 24 18:05:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:05:09.661204 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:05:09.661719 dv-cinder-840525-3-iscsi devstack@n-api.service[126993]: Wed Aug 24 18:05:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 18:06:30.815793 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 18:06:30.816363 dv-cinder-840525-3-iscsi devstack@n-api.service[126994]: Wed Aug 24 18:06:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!